-- Logs begin at Thu 2022-07-14 10:11:13 UTC, end at Thu 2022-07-14 11:16:50 UTC. -- Jul 14 10:47:51.518127 dv-cinder-846146-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 10:47:51.527640 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:47:51 2022] *** Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: nodename: dv-cinder-846146-7-iscsi Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: machine: x86_64 Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: clock source: unix Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: pcre jit disabled Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: detected number of CPU cores: 4 Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: current working directory: / Jul 14 10:47:51.529591 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: your processes number limit is 47680 Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: your memory page size is 4096 bytes Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: detected max file descriptor number: 2048 Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: lock engine: pthread robust mutexes Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: thunder lock: enabled Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 10:47:51.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:47:51.573324 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: Python main interpreter initialized at 0x558ab35f99c0 Jul 14 10:47:51.573324 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: python threads support enabled Jul 14 10:47:51.573324 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: your server socket listen backlog is limited to 100 connections Jul 14 10:47:51.573324 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:47:51.573680 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:47:51.573680 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: *** Operational MODE: preforking *** Jul 14 10:47:51.573981 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:47:51.573981 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: spawned uWSGI master process (pid: 118326) Jul 14 10:47:51.574179 dv-cinder-846146-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 10:47:51.577262 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: spawned uWSGI worker 1 (pid: 118327, cores: 1) Jul 14 10:47:51.577262 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: spawned uWSGI worker 2 (pid: 118328, cores: 1) Jul 14 10:47:51.577262 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:47:52.225422 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:47:52.235304 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:47:53.332841 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:47:53.332841 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: from cryptography.utils import int_from_bytes Jul 14 10:47:53.333538 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:47:53.333538 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: from cryptography.utils import int_from_bytes Jul 14 10:47:53.333653 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:47:53.333653 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: from cryptography.utils import int_from_bytes Jul 14 10:47:53.334039 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:47:53.334039 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: from cryptography.utils import int_from_bytes Jul 14 10:47:55.803123 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:47:55.803821 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:47:55.803952 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:47:55.804262 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:47:55.804512 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:47:55.804895 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.805219 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.805541 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.805857 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.806184 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.806510 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.806930 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:47:55.807313 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.807397 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:47:55.807481 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.807481 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.807618 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:47:55.807683 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.807812 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:47:55.807978 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.808078 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:47:55.808306 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-7-iscsi {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.808450 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.808583 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.808751 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.808885 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809058 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809181 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809384 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809524 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809692 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809802 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.809992 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.810082 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.810303 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.810393 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.810610 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.810835 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811251 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811251 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811403 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811471 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811545 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811754 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-7-iscsi {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.811899 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812089 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812204 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812390 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812534 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812688 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812829 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.812997 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813088 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813291 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813389 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813600 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813699 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813896 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.813992 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.814336 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-7-iscsi {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.814430 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.814648 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.814748 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.814952 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815054 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815248 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815335 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815581 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815672 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815890 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.815993 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.816192 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.816312 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.816506 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.816613 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.816804 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.816914 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.817118 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.817209 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.817416 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.817518 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.817755 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.817856 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-7-iscsi {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818067 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818165 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818363 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818455 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818660 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818763 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.818965 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819051 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819269 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819375 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819581 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819690 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819903 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.819999 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.820196 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.820289 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.820440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.820544 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.820743 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.820838 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.821056 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.821140 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.821368 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.821456 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.821681 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.821778 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822090 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822203 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822294 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822493 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822589 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822804 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.822939 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823120 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823206 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823419 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823504 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823717 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823808 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.823983 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824086 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824287 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824379 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824603 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824688 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824909 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.824993 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.825211 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.825297 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.825453 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.825549 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.825696 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.825815 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826010 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826134 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826318 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826436 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826618 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826747 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.826916 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.827146 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.827240 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.827392 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.827478 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.827694 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.827778 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828051 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828231 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828364 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828451 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828659 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828743 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.828967 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829064 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829274 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829363 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829572 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829763 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829870 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.829965 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.830171 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.830265 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.830483 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.830573 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.830783 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.830874 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831082 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831166 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831328 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831424 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831623 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831709 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.831943 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832031 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832263 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832347 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832564 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832657 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832866 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.832970 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.833186 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.833289 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.833459 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.833545 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.833760 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.833849 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834062 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834192 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834364 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834487 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834605 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834775 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.834907 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835039 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835170 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835290 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835460 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835582 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835759 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.835929 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836065 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836250 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836373 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836490 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836645 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836786 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.836944 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.837067 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.837244 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.837376 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.837572 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838138 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838274 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838405 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838525 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838651 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838771 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.838903 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839023 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839144 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839262 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839464 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839597 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839729 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.839849 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840015 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840135 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840267 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840397 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840524 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840643 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840761 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.840886 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841019 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841222 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841427 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841574 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841706 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841827 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.841946 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842073 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842204 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842402 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842580 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842709 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842832 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.842971 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.843094 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.843248 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.843378 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.843576 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.843753 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.843937 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844081 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844217 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844340 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844461 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844592 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844722 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.844844 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845058 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845250 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845384 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845516 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845638 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845756 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845875 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.845993 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.846194 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.846483 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.846624 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.846749 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.846869 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.846988 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.847117 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.847247 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.847375 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.847497 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.847616 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.847743 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.847864 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.848093 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.848224 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.848429 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.848609 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.848754 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.848894 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.849024 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.849144 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.849313 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.849460 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:47:55.849665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.849801 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.849923 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.850040 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.850194 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.850323 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.850527 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.850725 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.850868 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851000 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851131 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851252 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851416 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851553 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851749 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.851965 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852115 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852242 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852373 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852596 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852731 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852852 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.852971 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.853089 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.853310 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854066 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854214 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854338 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854338 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854563 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854563 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854798 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.854931 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855104 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855234 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855364 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855492 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855612 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855731 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.855856 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856025 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856134 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856255 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856371 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856574 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856698 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856834 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.856954 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857083 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857203 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857322 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857439 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857634 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857825 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.857960 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858083 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858203 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858321 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858533 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858725 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858858 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.858981 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.859103 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.859221 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.859442 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.859650 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.859909 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860044 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860183 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860403 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860558 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860697 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860822 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.860940 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861059 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861178 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861308 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861428 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861553 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861673 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861791 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.861910 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862045 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862174 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862385 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862574 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862706 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862828 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.862959 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.863081 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.863289 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.863470 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.863599 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.863721 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.863923 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864056 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864256 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864433 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864564 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864687 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864826 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.864948 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.865091 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.865226 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.865422 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.865613 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.865756 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.865881 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.866000 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.866119 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.866316 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.866509 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.866739 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.866879 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867003 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867122 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867241 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867379 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867503 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867622 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867739 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.867857 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.868100 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.868291 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.868434 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.868561 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.868690 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.869103 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.869611 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870124 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870124 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870369 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870490 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870611 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870742 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870870 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.870990 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871139 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871270 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871389 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871517 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871638 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871756 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.871922 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872045 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872179 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872307 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872434 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872554 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872673 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872799 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.872930 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873050 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873167 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873296 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873415 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873533 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873659 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873781 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.873898 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874015 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874133 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874258 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874391 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874512 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874629 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874749 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.874983 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.875174 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.875316 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.875441 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.875560 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.875679 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.875900 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.876174 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.876310 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.876434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.876553 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.876682 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.876905 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877041 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877163 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877282 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877399 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877525 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877645 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877772 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.877894 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878013 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878130 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878274 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878444 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878575 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878760 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.878950 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879091 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879216 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879347 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879477 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879606 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879764 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.879918 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.880180 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.880333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.880455 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.880574 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.880692 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.880819 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881029 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881222 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881355 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881491 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881614 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881733 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.881889 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882028 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882233 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882411 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882541 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882664 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882799 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.882921 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.883122 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.883302 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.883432 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.883554 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.883725 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.883857 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.884087 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.884264 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.884530 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885001 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885001 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885277 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885399 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885527 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885656 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885777 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.885905 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886026 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886152 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886375 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886512 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886763 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.886895 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887099 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887225 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887345 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887479 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887599 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887717 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887836 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.887991 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888111 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888249 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888380 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888505 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888624 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888742 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888861 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.888992 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889112 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889230 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889418 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889597 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889728 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889863 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.889986 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890096 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890286 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890407 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890589 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890697 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890891 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.890986 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.891187 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.891293 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.891488 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.891583 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.891779 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.891899 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.892106 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.892201 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.892407 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.892502 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.892715 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.892809 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893016 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893109 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893315 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893415 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893612 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893715 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.893909 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894011 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894208 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894301 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894504 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894605 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894795 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.894899 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.895088 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.895190 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.895387 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.895481 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.895689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.895791 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896027 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896118 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896332 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896437 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896626 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896729 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.896921 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897029 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897218 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897347 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897507 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897599 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897801 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.897887 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.898095 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.898179 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.898392 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.898478 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.898690 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.898774 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.899008 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.899435 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.899647 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.899734 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.899966 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.900076 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.900305 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.900764 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.900875 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.900959 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901039 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901117 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901195 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901285 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901450 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901555 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901744 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.901847 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902064 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902167 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902360 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902453 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902655 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902750 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.902957 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.903061 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.903261 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.903356 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.903558 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.903652 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.903859 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.904068 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.904197 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.904555 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.904643 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.904864 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.904959 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.905163 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.905248 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.905468 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.905559 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906092 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906392 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906524 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906645 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906770 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906770 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.906993 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907124 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907333 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907466 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907586 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907704 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907821 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.907988 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908110 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908228 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908348 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908467 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908593 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908714 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908832 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.908958 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.909121 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.909429 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.909551 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.909734 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.909870 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910034 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910157 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910339 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910463 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910641 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910765 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.910941 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911073 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911240 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911363 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911575 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911706 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911826 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.911961 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.912150 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.912270 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.912451 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.912576 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.912752 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.912861 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913059 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913167 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913357 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913485 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913687 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913838 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.913946 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914047 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914221 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914342 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914520 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914632 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914814 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.914934 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.915107 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.915233 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.915399 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.915509 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.915756 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.916098 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.916548 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.916657 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.916762 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.916872 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.916872 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917064 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917064 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917273 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917480 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917617 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917749 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917872 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.917999 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918120 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918248 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918368 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918486 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918613 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918778 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.918903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.919080 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.919203 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.919377 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.919505 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.919672 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.919794 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920016 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920140 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920324 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920457 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920625 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920746 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.920925 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921061 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921219 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921354 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921515 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921652 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921876 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.921998 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922132 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922252 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922379 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922507 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922657 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922780 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.922949 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.923073 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.923246 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.923369 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.923543 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.923673 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.923838 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924007 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924159 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924280 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924453 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924575 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924746 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.924877 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925038 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925334 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925465 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925623 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925744 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.925917 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926041 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926215 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926349 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926508 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926631 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926797 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.926919 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.927096 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.927300 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.927423 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.927624 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.927757 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.927897 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928019 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928151 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928273 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928399 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928554 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928677 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928856 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.928980 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.929154 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.929278 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.929446 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.929576 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.929757 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.929881 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930055 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930176 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930347 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930468 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930640 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930765 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.930933 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.931055 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.931222 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.931388 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932168 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932292 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932396 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932500 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932602 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932712 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932817 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.932817 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933006 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933108 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933234 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933451 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933579 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933685 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933787 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933889 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.933991 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.934170 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.934280 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.934995 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935132 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935238 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935340 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935452 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935563 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935666 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935767 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.935890 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936020 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936125 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936236 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936339 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936449 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936551 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936668 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936771 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.936872 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.937040 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.937151 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.939139 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.939860 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940056 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940186 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940316 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940439 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940569 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940698 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940819 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.940937 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941055 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941172 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941304 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941424 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941543 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941669 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941795 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.941930 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942050 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942184 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942375 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942499 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942618 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942746 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942866 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.942986 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943104 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943230 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943350 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943478 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943598 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943716 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943834 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.943967 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944085 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944217 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944344 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944464 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944590 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944718 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944847 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.944967 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945085 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945203 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945321 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945438 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945565 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945686 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945812 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.945931 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946050 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946167 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946295 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946423 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946550 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946669 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946787 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.946946 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.947232 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.947717 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.947860 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948052 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948177 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948306 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948427 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948546 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948665 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948784 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.948902 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949029 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949156 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949156 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949487 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949615 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949741 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949869 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.949989 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950114 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950236 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950354 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950472 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950605 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950726 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.950990 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951123 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951252 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951383 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951513 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951634 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951753 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.951901 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952023 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952155 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952277 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952408 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952591 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952714 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952833 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.952961 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953082 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953216 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953345 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953467 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953594 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953723 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953843 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.953970 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954091 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954209 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954338 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954459 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954587 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954708 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954829 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.954947 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955149 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955272 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955390 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955511 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955629 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955629 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.955914 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956054 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956175 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956293 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956412 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956531 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956660 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956788 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.956907 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957026 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957144 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957276 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957400 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957520 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957639 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957756 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957865 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.957991 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958110 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958231 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958349 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958497 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958627 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958791 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.958916 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.959089 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.959221 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.959407 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.959538 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.959720 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.959844 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960142 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960296 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960418 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960546 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960667 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960788 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.960957 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961145 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961269 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961389 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961538 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961679 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961833 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.961956 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.962149 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.962273 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.962460 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.962634 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.963298 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.963428 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.963549 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.963668 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.963795 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.963961 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964085 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964211 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964330 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964448 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964566 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964761 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.964891 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965012 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965139 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965259 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965386 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965508 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965626 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965793 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.965917 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966084 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966215 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966393 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966521 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966685 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966805 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.966987 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.967121 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.967287 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.967410 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.967584 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.967708 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.967895 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968035 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968188 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968315 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968505 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968627 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968801 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.968924 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.969097 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.969219 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.969394 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.969527 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.969703 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.969824 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970014 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970142 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970311 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970439 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970623 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970747 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.970923 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971053 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971270 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971396 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971524 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971645 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971765 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.971905 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.972121 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.972259 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.972415 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.972538 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.972724 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.972847 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973046 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973177 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973372 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973515 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973671 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973802 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.973971 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.974104 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.974270 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.974402 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.974569 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.974699 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.974870 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975002 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975167 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975290 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975462 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975584 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975756 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.975939 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976075 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976197 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976363 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976488 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976662 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976795 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.976953 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977091 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977247 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977368 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977535 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977658 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977827 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.977949 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.978136 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.978410 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.978861 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979001 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979124 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979244 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979371 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979501 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979628 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979748 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.979867 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980033 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980154 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980283 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980403 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980651 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980779 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.980898 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981027 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981148 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981282 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981469 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981594 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981714 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981843 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.981997 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.982120 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.982298 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.982428 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.982612 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.982737 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.982920 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.983050 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.983226 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.983349 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.983536 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.983655 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.983842 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.984106 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.984199 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.984432 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.984547 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.984744 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.984843 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985039 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985125 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985341 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985440 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985726 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.985946 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.986031 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.986251 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.986470 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.986557 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.986793 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.986880 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.987100 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.987196 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.987404 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.987491 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.987707 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.987793 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988037 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988152 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988349 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988446 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988649 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988737 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.988955 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989043 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989258 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989344 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989557 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989642 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989876 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.989965 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.990188 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.990275 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.990484 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.990577 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.990790 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.990884 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.991097 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.991190 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.991398 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.991493 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.991700 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.991792 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992022 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992126 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992335 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992507 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992638 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992726 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.992938 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993024 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993238 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993326 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993539 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993623 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993902 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.993989 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.994231 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.994318 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.994545 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.994629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.994849 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.994947 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.995150 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.995236 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.995449 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.995533 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.995748 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.995843 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.996081 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.996281 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.996369 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.996588 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.996675 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.996916 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997003 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997233 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997319 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997550 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997640 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997856 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.997944 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.998155 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.998250 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.998474 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.998664 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.998775 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.998968 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.999073 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.999291 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.999377 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.999608 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.999703 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:55.999946 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000037 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000254 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000360 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000556 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000651 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000853 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.000939 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.001154 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.001238 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.001448 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.001535 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.001748 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.001970 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.002055 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.002323 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.002418 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.002633 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.002717 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.002934 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003020 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003226 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003313 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003536 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003834 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.003936 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.004178 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.004382 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.004475 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.004712 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.004798 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005023 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005130 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005338 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005425 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005633 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.005930 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006228 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006330 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006527 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006612 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006822 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.006915 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.007120 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.007206 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.007412 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.007496 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.007710 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.007796 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008029 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008118 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008325 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008419 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008623 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008708 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.008922 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009009 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009215 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009308 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009560 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009857 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.009943 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.010151 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.010242 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.010452 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.010546 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.010745 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.010832 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011046 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011144 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011341 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011427 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011644 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011725 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.011965 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012075 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012266 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012351 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012560 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012646 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012861 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.012948 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.013156 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.013250 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.013455 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.013541 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.013749 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.013843 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014049 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014134 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014342 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014428 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014640 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014734 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.014942 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.015040 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.015283 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.015381 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.015571 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.015657 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.015863 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.016120 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.016205 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.016447 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.016535 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.016758 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.016845 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017062 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017154 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017365 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017460 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017678 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017763 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.017976 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.018063 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.018275 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.018498 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.018585 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.018826 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.018920 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.019138 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.019233 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.019457 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.019544 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.019761 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.019848 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020084 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020173 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020381 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020466 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020675 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020760 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.020978 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021070 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021271 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021365 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021568 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021653 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021866 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.021960 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.022163 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.022248 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.022461 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.022560 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.022757 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.022844 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023057 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023150 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023356 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023451 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023653 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023739 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.023997 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.024444 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.024661 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.024759 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.024967 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025053 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025300 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025590 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025590 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025810 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025895 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.025972 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.026177 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.026270 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.026491 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.026582 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.026793 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.026879 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.027089 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.027182 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.027385 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.027493 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.027684 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.027800 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028007 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028150 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028313 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028466 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028617 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028767 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.028935 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.029082 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.029241 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.029395 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.029538 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.029699 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.029942 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030042 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030247 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030333 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030558 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030652 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030869 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.030965 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.031168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.031269 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.031478 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.031566 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.031790 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.031899 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.032116 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.032214 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.032419 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.032512 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.032717 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.032803 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033027 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033113 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033329 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033415 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033626 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033713 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.033919 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034012 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034221 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034354 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034513 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034598 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034806 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.034899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.035101 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.035198 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.035400 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.035507 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.035699 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.035794 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036010 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036119 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036304 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036397 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036596 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036688 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036886 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.036981 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.037178 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.037271 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.037468 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.037553 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.037761 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.037849 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038052 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038136 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038346 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038431 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038636 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038721 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.038923 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039014 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039213 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039298 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039501 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039594 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039793 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.039930 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.040116 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.040214 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.040409 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.040497 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.040787 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.040883 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.041098 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.041249 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.041393 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.041565 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.041683 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.041880 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042003 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042200 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042327 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042509 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042632 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042810 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.042945 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.043139 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.043248 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.043439 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.043559 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.043743 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.043858 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044073 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044188 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044376 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044499 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044679 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044801 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.044981 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.045099 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.045301 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.045420 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.045622 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.045718 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.045921 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046007 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046238 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046326 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046550 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046649 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046862 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.046949 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.047161 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.047247 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.047464 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.047558 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.047781 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.048110 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.048364 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.048461 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.048704 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.048943 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.049034 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.049296 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.049475 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.049642 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.049885 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.049973 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.050183 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.050269 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.050490 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.050577 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.050796 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.050882 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.051108 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.051192 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.051415 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.051503 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.051713 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.051797 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052043 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052143 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052349 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052437 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052656 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052742 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.052961 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053058 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053313 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053409 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053572 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053666 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053878 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.053982 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.054196 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.054284 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.054493 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.054586 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.054733 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:47:56.054829 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.055099 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.055416 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.055753 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.056081 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.056496 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.056817 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.057134 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.057438 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.057733 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:47:56.057969 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:47:56.116390 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Registered counter for database nova_api Jul 14 10:47:56.118421 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO dbcounter [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Registered counter for database nova_api Jul 14 10:47:56.233763 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.235537 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_db.sqlalchemy.engines [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.240711 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.242032 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writer thread running {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.297489 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.context [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f81cba64-582e-4504-8b43-6c2a9f412413(cell1) {{(pid=118327) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:47:56.298086 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.context [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f81cba64-582e-4504-8b43-6c2a9f412413(cell1) {{(pid=118328) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:47:56.301471 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:47:56.302007 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:47:56.303023 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:47:56.303627 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:47:56.303769 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:47:56.304379 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:47:56.305937 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:47:56.307221 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:47:56.308198 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Registered counter for database nova_cell0 Jul 14 10:47:56.308932 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO dbcounter [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Registered counter for database nova_cell0 Jul 14 10:47:56.312285 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Registered counter for database nova_cell1 Jul 14 10:47:56.312707 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO dbcounter [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Registered counter for database nova_cell1 Jul 14 10:47:56.320868 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.324121 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_db.sqlalchemy.engines [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.324272 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.325771 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_db.sqlalchemy.engines [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.330801 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writer thread running {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.330929 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.332203 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.469876 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writer thread running {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.478553 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Registered counter for database nova_cell0 Jul 14 10:47:56.480553 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO dbcounter [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Registered counter for database nova_cell0 Jul 14 10:47:56.486550 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.488336 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_db.sqlalchemy.engines [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:47:56.491998 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.493521 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writer thread running {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:47:56.825310 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: WARNING keystonemiddleware.auth_token [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:47:56.827431 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:47:56.832690 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: WARNING keystonemiddleware.auth_token [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:47:56.834620 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:47:57.170571 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: WARNING keystonemiddleware.auth_token [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:47:57.175471 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:47:57.176798 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: WARNING keystonemiddleware.auth_token [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:47:57.181582 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-2b48fb5c-8950-4ba6-94de-846c9e5318df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:47:57.182059 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558ab35f99c0 pid: 118328 (default app) Jul 14 10:47:57.184136 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:47:57.185313 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Jul 14 10:47:57.185707 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Thu Jul 14 10:47:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:47:57.186898 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558ab35f99c0 pid: 118327 (default app) Jul 14 10:49:14.096434 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:14.097473 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 14 10:49:14.098037 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:14.114815 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:14.116591 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:14.117650 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:14.119029 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:14.970312 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2a46f117-8cd6-404d-bbd9-84ffdf909d15 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:15.001330 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2a46f117-8cd6-404d-bbd9-84ffdf909d15 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.896379 Jul 14 10:49:15.008567 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 10:49:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:49:17.219503 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:17.220585 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-ff18ee6f-e7cc-48ad-b9a9-b6961c3e726e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 14 10:49:17.225930 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:17.690511 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f3652ee5-41db-48a1-b46d-03d3ae6dc464 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:17.709258 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:17.709258 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: warnings.warn(msg) Jul 14 10:49:17.740365 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f3652ee5-41db-48a1-b46d-03d3ae6dc464 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.512717 Jul 14 10:49:17.741343 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:17.755435 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_api:SELECT=3 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:17.756262 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_cell0:SELECT=3 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:17.757524 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_cell1:SELECT=3 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:17.758387 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:17.967984 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-998fc1f0-d5f7-4e4d-87fb-5efbd507e096 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:17.970349 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:17.970349 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: warnings.warn(msg) Jul 14 10:49:18.045375 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-998fc1f0-d5f7-4e4d-87fb-5efbd507e096 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295886 Jul 14 10:49:18.045971 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 10:49:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:49:20.355066 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f3652ee5-41db-48a1-b46d-03d3ae6dc464 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:20.356488 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f3652ee5-41db-48a1-b46d-03d3ae6dc464 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jul 14 10:49:20.356975 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:21.035169 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-236b3879-b2a2-4894-8a93-e42f4a4a8a23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:21.054122 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:21.054122 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: warnings.warn(msg) Jul 14 10:49:21.077558 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-236b3879-b2a2-4894-8a93-e42f4a4a8a23 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714357 Jul 14 10:49:21.078472 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:21.090286 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-106e39bd-8d9d-4e39-9a4b-3eecd61ba95e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:21.092269 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:21.092269 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: warnings.warn(msg) Jul 14 10:49:21.128195 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-106e39bd-8d9d-4e39-9a4b-3eecd61ba95e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041513 Jul 14 10:49:21.139941 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 10:49:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:49:23.435477 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-236b3879-b2a2-4894-8a93-e42f4a4a8a23 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:23.436623 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-236b3879-b2a2-4894-8a93-e42f4a4a8a23 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 14 10:49:23.437025 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:23.848685 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-beb178ac-02bb-4bc1-8201-2b77adabb9e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "disk": 10, "id": "d2"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:23.868996 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-beb178ac-02bb-4bc1-8201-2b77adabb9e9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425922 Jul 14 10:49:23.869544 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:23.881613 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-0a3d5cb6-f796-46d7-a067-3dec740b4fbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:23.905415 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-0a3d5cb6-f796-46d7-a067-3dec740b4fbc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027640 Jul 14 10:49:23.905964 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 10:49:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:49:26.129304 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-beb178ac-02bb-4bc1-8201-2b77adabb9e9 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:26.130591 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-beb178ac-02bb-4bc1-8201-2b77adabb9e9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 14 10:49:26.131214 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:26.579918 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-c3571205-10a5-47ac-a602-a5d7efe6c686 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:26.602690 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-c3571205-10a5-47ac-a602-a5d7efe6c686 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465493 Jul 14 10:49:26.603723 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:26.615653 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5574a25e-e944-48a0-af24-b4a6d68d4e7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:26.640004 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5574a25e-e944-48a0-af24-b4a6d68d4e7b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028353 Jul 14 10:49:26.640485 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 10:49:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:49:28.854861 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-c3571205-10a5-47ac-a602-a5d7efe6c686 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:28.856150 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-c3571205-10a5-47ac-a602-a5d7efe6c686 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 14 10:49:28.856976 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:29.281709 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-33dd79b2-2098-4379-a218-6bf834f3935c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:29.300900 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-33dd79b2-2098-4379-a218-6bf834f3935c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437768 Jul 14 10:49:29.301758 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:29.314003 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-9f00b2bb-f75b-46be-9c84-2c2bf3923e7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:29.340838 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-9f00b2bb-f75b-46be-9c84-2c2bf3923e7c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030719 Jul 14 10:49:29.341642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 10:49:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:49:31.588935 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-33dd79b2-2098-4379-a218-6bf834f3935c admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:31.589952 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-33dd79b2-2098-4379-a218-6bf834f3935c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 10:49:31.590360 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:32.060692 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-762da861-5d09-4668-9660-1721028e9631 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:32.084204 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-762da861-5d09-4668-9660-1721028e9631 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.486625 Jul 14 10:49:32.084758 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 10:49:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:49:34.295509 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-33dd79b2-2098-4379-a218-6bf834f3935c admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:34.296595 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-33dd79b2-2098-4379-a218-6bf834f3935c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 14 10:49:34.296988 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:34.781940 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-6d73a4c4-6eb9-4cc4-9d50-a2f73e214207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:34.803861 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-6d73a4c4-6eb9-4cc4-9d50-a2f73e214207 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.500904 Jul 14 10:49:34.804445 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:34.817162 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-50132ceb-0b99-4682-a39f-eb1d0a09de8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:34.842875 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-50132ceb-0b99-4682-a39f-eb1d0a09de8a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029665 Jul 14 10:49:34.843474 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 10:49:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:49:37.153522 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-6d73a4c4-6eb9-4cc4-9d50-a2f73e214207 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:37.154538 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-6d73a4c4-6eb9-4cc4-9d50-a2f73e214207 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 10:49:37.154925 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:37.561045 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2817d4ea-a7c8-4dbf-a127-47450d0cafbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:37.580867 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2817d4ea-a7c8-4dbf-a127-47450d0cafbc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418986 Jul 14 10:49:37.581424 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:37.593431 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-3359ec9e-acf9-4c3f-9caf-bff39e76e697 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:37.619788 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-3359ec9e-acf9-4c3f-9caf-bff39e76e697 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030033 Jul 14 10:49:37.620406 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 10:49:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:49:39.828653 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2817d4ea-a7c8-4dbf-a127-47450d0cafbc admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:39.829660 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2817d4ea-a7c8-4dbf-a127-47450d0cafbc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 14 10:49:39.830029 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:40.201157 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-49ea0066-5c58-4250-8213-6d98eaa94e14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:40.220086 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-49ea0066-5c58-4250-8213-6d98eaa94e14 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.383853 Jul 14 10:49:40.224222 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:49:40.232659 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cbfda70a-d463-4a42-9215-369185cf392a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:40.255541 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cbfda70a-d463-4a42-9215-369185cf392a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026530 Jul 14 10:49:40.256327 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 10:49:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:49:42.618744 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-49ea0066-5c58-4250-8213-6d98eaa94e14 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:42.619750 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-49ea0066-5c58-4250-8213-6d98eaa94e14 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 10:49:42.620441 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:43.085012 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b722212f-df28-4795-922b-c5ac347d05b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:43.105640 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b722212f-df28-4795-922b-c5ac347d05b0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479472 Jul 14 10:49:43.106502 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:43.118568 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-c3874d07-3261-4629-9aad-8c278272aa0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:43.144562 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-c3874d07-3261-4629-9aad-8c278272aa0f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029786 Jul 14 10:49:43.145564 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 10:49:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:49:45.377662 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b722212f-df28-4795-922b-c5ac347d05b0 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:49:45.379343 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b722212f-df28-4795-922b-c5ac347d05b0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002475 Jul 14 10:49:45.379924 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:49:45.922682 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-659dc605-941e-4108-83d5-0276584a430a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:45.948858 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-659dc605-941e-4108-83d5-0276584a430a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.563179 Jul 14 10:49:45.949426 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 10:49:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:49:45.961657 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-69c0d5db-36c9-4e34-a5d6-271ee5d26dc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:49:45.965270 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:45.987900 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-69c0d5db-36c9-4e34-a5d6-271ee5d26dc1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029869 Jul 14 10:49:45.988835 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 10:49:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:50:05.460760 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-659dc605-941e-4108-83d5-0276584a430a admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:05.461767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-659dc605-941e-4108-83d5-0276584a430a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 14 10:50:05.462156 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:50:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:05.893905 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-97d41d47-80e5-46a5-8640-fe9dd2d5a076 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:05.910987 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-97d41d47-80e5-46a5-8640-fe9dd2d5a076 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442819 Jul 14 10:50:05.911522 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 10:50:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:06.981953 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-659dc605-941e-4108-83d5-0276584a430a admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:06.983005 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-659dc605-941e-4108-83d5-0276584a430a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 14 10:50:06.983405 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:07.549636 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1190290b-0a53-410a-9808-961cb82c9f6d admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:07.555359 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-1190290b-0a53-410a-9808-961cb82c9f6d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1190290b-0a53-410a-9808-961cb82c9f6d admin admin] Request method failure captured: Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Accept: application/json Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Accept-Encoding: gzip, deflate Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Connection: keep-alive Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Host: 10.222.0.27 Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Openstack-Api-Version: compute 2.90 Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: User-Agent: python-novaclient Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABiz_TehETwiQEeco4j0myIM6QPJ26jAluQbWQffEIwyjJTe3bfmNcsotDKY5UIVAR60RmOX4LRy4_XXehtshIQS2rpr1WRbTZ8PoghbdZVn7rsgq4-MoYmoEKXMW1UIkE9agO8nExURNaBVxJUY5j5gANtzGiYUESyUGYJyxJSoZh8jGo Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Name: admin Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Role: reader,member,admin Jul 14 10:50:07.558665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Roles: reader,member,admin Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd0314351a554271b0b9af50b68ac028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant: admin Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant-Name: admin Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User: admin Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Id: e56c84bcaa9a49c8bd5f12e10aeab889 Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Name: admin Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: method: > Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: exception: Flavor 42 could not be found. Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: action_args: {'id': '42'} Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:50:07.560358 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:07.561523 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.563496 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1190290b-0a53-410a-9808-961cb82c9f6d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:50:07.565044 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1190290b-0a53-410a-9808-961cb82c9f6d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.439745 Jul 14 10:50:07.565044 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 10:50:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:07.571100 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-3f634313-9534-48cb-8d54-25b52d0b0008 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:07.574128 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:50:07.593697 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-3f634313-9534-48cb-8d54-25b52d0b0008 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026195 Jul 14 10:50:07.594431 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 10:50:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:07.604389 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bc3c2ca6-3bd6-440d-9332-693062dd61bd admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:07.625954 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bc3c2ca6-3bd6-440d-9332-693062dd61bd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025229 Jul 14 10:50:07.626746 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 10:50:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:07.636675 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-6babda29-77a2-44b1-90c1-ec4324436b65 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:07.643202 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.wsgi [None req-6babda29-77a2-44b1-90c1-ec4324436b65 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-6babda29-77a2-44b1-90c1-ec4324436b65 admin admin] Request method failure captured: Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Accept: application/json Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Accept-Encoding: gzip, deflate Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Connection: keep-alive Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Content-Length: 0 Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Host: 10.222.0.27 Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Openstack-Api-Version: compute 2.90 Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Openstack-System-Scope: None Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: User-Agent: python-novaclient Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Auth-Token: gAAAAABiz_TehETwiQEeco4j0myIM6QPJ26jAluQbWQffEIwyjJTe3bfmNcsotDKY5UIVAR60RmOX4LRy4_XXehtshIQS2rpr1WRbTZ8PoghbdZVn7rsgq4-MoYmoEKXMW1UIkE9agO8nExURNaBVxJUY5j5gANtzGiYUESyUGYJyxJSoZh8jGo Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Domain-Id: None Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Domain-Name: None Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Identity-Status: Confirmed Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Is-Admin-Project: True Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Domain-Id: default Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Domain-Name: Default Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Name: admin Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Role: reader,member,admin Jul 14 10:50:07.646642 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Roles: reader,member,admin Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd0314351a554271b0b9af50b68ac028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant: admin Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant-Name: admin Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User: admin Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Domain-Id: default Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Domain-Name: Default Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Id: e56c84bcaa9a49c8bd5f12e10aeab889 Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Name: admin Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: method: > Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: exception: Flavor 42 could not be found. Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: action_args: {'id': '42'} Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:50:07.647982 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:07.648903 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:07.650168 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-6babda29-77a2-44b1-90c1-ec4324436b65 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=118328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:50:07.651420 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-6babda29-77a2-44b1-90c1-ec4324436b65 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015329 Jul 14 10:50:07.651420 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 10:50:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:08.659977 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bc3c2ca6-3bd6-440d-9332-693062dd61bd admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:08.660982 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bc3c2ca6-3bd6-440d-9332-693062dd61bd admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 14 10:50:08.661375 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:09.218900 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-21d9970a-728d-4b8e-982c-908a40e2ae61 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:09.224761 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.wsgi [None req-21d9970a-728d-4b8e-982c-908a40e2ae61 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-21d9970a-728d-4b8e-982c-908a40e2ae61 admin admin] Request method failure captured: Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Accept: application/json Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Accept-Encoding: gzip, deflate Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Connection: keep-alive Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Content-Length: 0 Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Host: 10.222.0.27 Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Openstack-Api-Version: compute 2.90 Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Openstack-System-Scope: None Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: User-Agent: python-novaclient Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Auth-Token: gAAAAABiz_TgHLwGyu2ZNLOmjKGo4fK_FvK7W9PcSnaV4m2iN04ROhxDdLOp4VSF0PAarfkkaYaWD2f2g-QEYTMW2dEiTFtl17HaIcIKaUuCsYRBj48nQUARzGsoJvqx3PEdTeYHmz2bmsYn93O-wJ11GJwu9ahVUjAHMhY4KOqNhA0pjuT296c Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Domain-Id: None Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Domain-Name: None Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Identity-Status: Confirmed Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Is-Admin-Project: True Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Domain-Id: default Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Domain-Name: Default Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Name: admin Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Role: reader,member,admin Jul 14 10:50:09.226285 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Roles: reader,member,admin Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd0314351a554271b0b9af50b68ac028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant: admin Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant-Name: admin Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User: admin Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Domain-Id: default Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Domain-Name: Default Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Id: e56c84bcaa9a49c8bd5f12e10aeab889 Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Name: admin Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: method: > Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: exception: Flavor 84 could not be found. Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: action_args: {'id': '84'} Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:50:09.227654 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:09.228899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.230306 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-21d9970a-728d-4b8e-982c-908a40e2ae61 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=118328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:50:09.232108 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-21d9970a-728d-4b8e-982c-908a40e2ae61 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.430450 Jul 14 10:50:09.232108 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 10:50:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:09.239719 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a376ac91-08f8-4eb4-98d7-f5815d4fcca7 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:09.254333 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a376ac91-08f8-4eb4-98d7-f5815d4fcca7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018923 Jul 14 10:50:09.254893 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 10:50:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:09.267325 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-bec5c030-793c-4c0c-a680-f0f6320a2f25 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:09.286972 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-bec5c030-793c-4c0c-a680-f0f6320a2f25 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025805 Jul 14 10:50:09.287492 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 10:50:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:09.299726 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b3719a5e-f56b-40b4-8167-4127d73a1359 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:09.307811 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-b3719a5e-f56b-40b4-8167-4127d73a1359 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b3719a5e-f56b-40b4-8167-4127d73a1359 admin admin] Request method failure captured: Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Accept: application/json Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Accept-Encoding: gzip, deflate Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Connection: keep-alive Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Host: 10.222.0.27 Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Openstack-Api-Version: compute 2.90 Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: User-Agent: python-novaclient Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABiz_TgHLwGyu2ZNLOmjKGo4fK_FvK7W9PcSnaV4m2iN04ROhxDdLOp4VSF0PAarfkkaYaWD2f2g-QEYTMW2dEiTFtl17HaIcIKaUuCsYRBj48nQUARzGsoJvqx3PEdTeYHmz2bmsYn93O-wJ11GJwu9ahVUjAHMhY4KOqNhA0pjuT296c Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Name: admin Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Role: reader,member,admin Jul 14 10:50:09.310102 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Roles: reader,member,admin Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd0314351a554271b0b9af50b68ac028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant: admin Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant-Name: admin Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User: admin Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Id: e56c84bcaa9a49c8bd5f12e10aeab889 Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Name: admin Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: method: > Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: exception: Flavor 84 could not be found. Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: action_args: {'id': '84'} Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:50:09.311621 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:09.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:09.314440 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b3719a5e-f56b-40b4-8167-4127d73a1359 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:50:09.315716 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b3719a5e-f56b-40b4-8167-4127d73a1359 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017792 Jul 14 10:50:09.315716 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 10:50:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:10.285899 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-bec5c030-793c-4c0c-a680-f0f6320a2f25 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:10.286905 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-bec5c030-793c-4c0c-a680-f0f6320a2f25 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 14 10:50:10.287292 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:50:10.880939 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b304b5ac-6a64-408b-b022-b04370a6773f admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:10.887120 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-b304b5ac-6a64-408b-b022-b04370a6773f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b304b5ac-6a64-408b-b022-b04370a6773f admin admin] Request method failure captured: Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Accept: application/json Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Accept-Encoding: gzip, deflate Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Connection: keep-alive Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Host: 10.222.0.27 Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Openstack-Api-Version: compute 2.90 Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: User-Agent: python-novaclient Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABiz_TiM1NUTVLQu_yGvIRZgvXHEyrzfMHKbvC9SsqU3V9cRpDazPBzPbapzB-vx-jRfdfQe6R3s-G9Cr1VKjB5dpMgoeqsR43dk_xc5rhkU6dE-lNQNhGPfTM0J_Z2ZeZhI6pv9BcQzgT7T5mRyw47kSopQejsejk5ilFHKFf2loh8Z7s Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Project-Name: admin Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Role: reader,member,admin Jul 14 10:50:10.888629 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Roles: reader,member,admin Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd0314351a554271b0b9af50b68ac028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant: admin Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-Tenant-Name: admin Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User: admin Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Id: e56c84bcaa9a49c8bd5f12e10aeab889 Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: X-User-Name: admin Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: method: > Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: exception: Flavor 451 could not be found. Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: action_args: {'id': '451'} Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:50:10.890434 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:10.891276 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.892689 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b304b5ac-6a64-408b-b022-b04370a6773f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:50:10.894034 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b304b5ac-6a64-408b-b022-b04370a6773f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.462753 Jul 14 10:50:10.894034 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 10:50:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:10.900683 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-f709abe0-1813-49c4-b152-48f6c164d9ff admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:10.914835 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-f709abe0-1813-49c4-b152-48f6c164d9ff admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017666 Jul 14 10:50:10.915369 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 10:50:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:10.925124 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:10.940430 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018883 Jul 14 10:50:10.941181 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 10:50:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:50:10.950503 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-d2a79ca8-e35c-476b-9da5-66ee326bc871 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:10.956823 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.wsgi [None req-d2a79ca8-e35c-476b-9da5-66ee326bc871 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-d2a79ca8-e35c-476b-9da5-66ee326bc871 admin admin] Request method failure captured: Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Accept: application/json Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Accept-Encoding: gzip, deflate Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Connection: keep-alive Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Content-Length: 0 Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Host: 10.222.0.27 Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Openstack-Api-Version: compute 2.90 Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Openstack-System-Scope: None Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: User-Agent: python-novaclient Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Auth-Token: gAAAAABiz_TiM1NUTVLQu_yGvIRZgvXHEyrzfMHKbvC9SsqU3V9cRpDazPBzPbapzB-vx-jRfdfQe6R3s-G9Cr1VKjB5dpMgoeqsR43dk_xc5rhkU6dE-lNQNhGPfTM0J_Z2ZeZhI6pv9BcQzgT7T5mRyw47kSopQejsejk5ilFHKFf2loh8Z7s Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Domain-Id: None Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Domain-Name: None Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Identity-Status: Confirmed Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Is-Admin-Project: True Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Domain-Id: default Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Domain-Name: Default Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Project-Name: admin Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Role: reader,member,admin Jul 14 10:50:10.958333 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Roles: reader,member,admin Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd0314351a554271b0b9af50b68ac028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd0314351a554271b0b9af50b68ac028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant: admin Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant-Id: dd0314351a554271b0b9af50b68ac028 Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-Tenant-Name: admin Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User: admin Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Domain-Id: default Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Domain-Name: Default Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Id: e56c84bcaa9a49c8bd5f12e10aeab889 Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: X-User-Name: admin Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: method: > Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: exception: Flavor 451 could not be found. Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: action_args: {'id': '451'} Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:50:10.959767 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:10.960719 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: ERROR nova.api.openstack.wsgi Jul 14 10:50:10.962018 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-d2a79ca8-e35c-476b-9da5-66ee326bc871 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=118328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:50:10.963247 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-d2a79ca8-e35c-476b-9da5-66ee326bc871 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012823 Jul 14 10:50:10.963247 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 10:50:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:11.947111 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:11.948167 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 14 10:50:11.948536 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:12.515464 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-aa7d766f-4055-4228-b57b-dd6d1dac4781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:50:12.539638 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-aa7d766f-4055-4228-b57b-dd6d1dac4781 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453206 Jul 14 10:50:12.540343 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 10:50:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:50:13.528516 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:13.529517 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 10:50:13.529908 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:14.099106 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-143f4d47-7e61-4a1e-9274-16070d74a488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:50:14.119717 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-143f4d47-7e61-4a1e-9274-16070d74a488 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.453570 Jul 14 10:50:14.120296 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 10:50:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:50:15.106497 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:15.107495 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 14 10:50:15.107897 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:15.670755 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-3eaa9839-c5a3-4849-a5f6-cc80ef0aece1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:50:15.693607 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-3eaa9839-c5a3-4849-a5f6-cc80ef0aece1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.441163 Jul 14 10:50:15.694148 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 10:50:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:50:16.698891 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:16.699904 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 14 10:50:16.700291 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:17.259030 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-91ddf94e-83d1-434d-83fb-074d57117923 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:50:17.284942 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-91ddf94e-83d1-434d-83fb-074d57117923 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.448885 Jul 14 10:50:17.285492 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 10:50:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:50:18.269239 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:18.270277 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 14 10:50:18.270675 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:50:18.829420 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-08907d36-8bf0-4d5a-9172-aa1e2354d299 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:50:18.854266 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-08907d36-8bf0-4d5a-9172-aa1e2354d299 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.447394 Jul 14 10:50:18.854798 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Jul 14 10:50:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:51:11.982329 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:51:11.983865 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd017d06-5c3e-4a16-88a5-7c4cf2ee589b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Jul 14 10:51:11.984528 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 10:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:51:11.995288 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:12.428170 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-fd0338c1-f109-4ce8-8adf-12199590a3b2 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:51:12.456271 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-fd0338c1-f109-4ce8-8adf-12199590a3b2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.465441 Jul 14 10:51:12.456771 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 10:51:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:51:12.477879 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:12.481995 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5c952657-d151-436d-a439-710692531f81 admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:51:12.490336 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5c952657-d151-436d-a439-710692531f81 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013861 Jul 14 10:51:12.490853 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Thu Jul 14 10:51:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:51:12.505197 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-34da4858-4b7f-4277-9c33-049ee769ccda admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:51:12.513559 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-34da4858-4b7f-4277-9c33-049ee769ccda admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013379 Jul 14 10:51:12.514461 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Thu Jul 14 10:51:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:51:12.529780 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:51:12.545597 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019346 Jul 14 10:51:12.546481 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Thu Jul 14 10:51:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:51:12.561998 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-d821e539-2d65-4597-8450-f485e697cc8c admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:51:12.570504 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-d821e539-2d65-4597-8450-f485e697cc8c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013854 Jul 14 10:51:12.571033 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Thu Jul 14 10:51:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:54:32.224836 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:32.225841 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 14 10:54:32.226226 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:54:32.367351 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_api:SELECT=6 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:32.544032 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-391c9ada-42c2-4ba0-b7b1-62def6953680 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:32.545257 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:54:32.545257 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: warnings.warn(msg) Jul 14 10:54:32.546577 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-391c9ada-42c2-4ba0-b7b1-62def6953680 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:32.547000 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-391c9ada-42c2-4ba0-b7b1-62def6953680 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:32.547762 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-391c9ada-42c2-4ba0-b7b1-62def6953680 admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:32.548235 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-391c9ada-42c2-4ba0-b7b1-62def6953680 admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:32.581445 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-391c9ada-42c2-4ba0-b7b1-62def6953680 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216451 Jul 14 10:54:32.581994 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 10:54:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:54:33.419384 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:33.421072 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Jul 14 10:54:33.421513 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:54:33.617432 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-296e16fd-70c0-418f-8098-3767f823b6e2 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:33.618638 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:54:33.618638 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: warnings.warn(msg) Jul 14 10:54:33.620032 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-296e16fd-70c0-418f-8098-3767f823b6e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:33.620409 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-296e16fd-70c0-418f-8098-3767f823b6e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:33.621199 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-296e16fd-70c0-418f-8098-3767f823b6e2 admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:33.621615 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-296e16fd-70c0-418f-8098-3767f823b6e2 admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:33.641552 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-296e16fd-70c0-418f-8098-3767f823b6e2 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081550 Jul 14 10:54:33.642112 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 10:54:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:54:44.935665 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:44.936898 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Jul 14 10:54:44.937284 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:54:45.093888 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_cell0:SELECT=4 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:45.094564 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_cell1:SELECT=4 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:45.095251 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG dbcounter [-] [118328] Writing DB stats nova_api:SELECT=8 {{(pid=118328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:45.162023 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-1560ae9d-bed4-4c23-9aa3-519097713cac admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:45.163212 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:54:45.163212 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: warnings.warn(msg) Jul 14 10:54:45.164428 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-1560ae9d-bed4-4c23-9aa3-519097713cac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:45.164864 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-1560ae9d-bed4-4c23-9aa3-519097713cac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:45.165641 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-1560ae9d-bed4-4c23-9aa3-519097713cac admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:45.166061 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-1560ae9d-bed4-4c23-9aa3-519097713cac admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:45.190825 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-1560ae9d-bed4-4c23-9aa3-519097713cac admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.104791 Jul 14 10:54:45.191382 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 10:54:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:54:46.017244 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:46.018745 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f459e405-eeda-4eb8-838f-44c021fb2dff admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Jul 14 10:54:46.019348 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 10:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:54:46.217935 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG nova.api.openstack.wsgi [None req-48397f1b-a7ab-4165-8cea-4263d28207b2 admin admin] Calling method '>' {{(pid=118328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:54:46.219104 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:54:46.219104 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: warnings.warn(msg) Jul 14 10:54:46.220328 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-48397f1b-a7ab-4165-8cea-4263d28207b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:46.220760 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-48397f1b-a7ab-4165-8cea-4263d28207b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:46.221541 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-48397f1b-a7ab-4165-8cea-4263d28207b2 admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:54:46.221960 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: DEBUG oslo_concurrency.lockutils [None req-48397f1b-a7ab-4165-8cea-4263d28207b2 admin admin] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:54:46.243563 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: INFO nova.api.openstack.requestlog [None req-48397f1b-a7ab-4165-8cea-4263d28207b2 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087015 Jul 14 10:54:46.244140 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: [pid: 118328|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 10:54:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:55:43.072952 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: Thu Jul 14 10:55:43 2022 - graceful shutdown triggered... Jul 14 10:55:43.073085 dv-cinder-846146-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 10:55:43.074108 dv-cinder-846146-7-iscsi devstack@n-api.service[118328]: Gracefully killing worker 2 (pid: 118328)... Jul 14 10:55:43.074554 dv-cinder-846146-7-iscsi devstack@n-api.service[118327]: Gracefully killing worker 1 (pid: 118327)... Jul 14 10:55:44.075321 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: worker 1 buried after 1 seconds Jul 14 10:55:44.075321 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: worker 2 buried after 1 seconds Jul 14 10:55:44.075321 dv-cinder-846146-7-iscsi devstack@n-api.service[118326]: goodbye to uWSGI. Jul 14 10:55:44.078199 dv-cinder-846146-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 10:55:44.078943 dv-cinder-846146-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 10:55:44.082918 dv-cinder-846146-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 10:55:44.096520 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:55:44 2022] *** Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: nodename: dv-cinder-846146-7-iscsi Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: machine: x86_64 Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: clock source: unix Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: pcre jit disabled Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: detected number of CPU cores: 4 Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: current working directory: / Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: your processes number limit is 47680 Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: your memory page size is 4096 bytes Jul 14 10:55:44.098551 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: detected max file descriptor number: 2048 Jul 14 10:55:44.099387 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: lock engine: pthread robust mutexes Jul 14 10:55:44.099387 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: thunder lock: enabled Jul 14 10:55:44.099387 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 10:55:44.099387 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:55:44.143058 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: Python main interpreter initialized at 0x562014f359c0 Jul 14 10:55:44.143058 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: python threads support enabled Jul 14 10:55:44.143058 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: your server socket listen backlog is limited to 100 connections Jul 14 10:55:44.143058 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:55:44.143513 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:55:44.143513 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: *** Operational MODE: preforking *** Jul 14 10:55:44.143820 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:55:44.143820 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: spawned uWSGI master process (pid: 133208) Jul 14 10:55:44.144024 dv-cinder-846146-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 10:55:44.144612 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: spawned uWSGI worker 1 (pid: 133220, cores: 1) Jul 14 10:55:44.145146 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: spawned uWSGI worker 2 (pid: 133221, cores: 1) Jul 14 10:55:44.145423 dv-cinder-846146-7-iscsi devstack@n-api.service[133208]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:55:44.800561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:55:44.818778 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:55:45.992689 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:55:45.992689 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: from cryptography.utils import int_from_bytes Jul 14 10:55:45.993357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:55:45.993357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: from cryptography.utils import int_from_bytes Jul 14 10:55:46.033867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:55:46.033867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: from cryptography.utils import int_from_bytes Jul 14 10:55:46.034523 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:55:46.034523 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: from cryptography.utils import int_from_bytes Jul 14 10:55:48.338223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:55:48.338807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:55:48.339004 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:55:48.339374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:55:48.339632 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:55:48.340054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.340389 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.340708 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.341029 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.341359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.341669 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.342038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.342983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.343325 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.343590 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.343929 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.344264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-7-iscsi {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.344591 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.344901 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.345217 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.345540 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.345851 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.346175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.346481 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.346981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.347138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:55:48.347512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:55:48.347584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.347716 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.347958 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:55:48.348044 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.348323 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:55:48.348536 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.348635 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:55:48.348722 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.348970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.349129 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.349288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.349444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.349582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.349713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.349906 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-7-iscsi {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350863 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.350952 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.351184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.351274 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.351518 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.351606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.351780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.351966 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.352157 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.352309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.352470 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-7-iscsi {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.352570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.352799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.352940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.353116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.353337 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.353445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.353532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.353708 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.353809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.354040 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.354194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.354351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.354443 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.354663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.354800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.355033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.355240 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.355356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.355452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.355607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.355776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.356908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.357040 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.357148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.357388 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.357572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.357756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.358086 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.358234 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.358372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.358558 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.358782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-7-iscsi {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.358887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.359057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.359151 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.359382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.359486 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.359701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.359806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360052 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360213 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360771 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.360985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.361079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.361294 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.361398 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.361597 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.361697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.361942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.362076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.362185 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.362304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.362524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.362667 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.362890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363164 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363266 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363788 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.363947 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364224 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364417 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364731 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364828 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.364983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.365086 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.365298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.365394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.365611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.365716 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.365937 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366267 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366545 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366830 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.366913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.367178 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.367362 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.367525 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.367745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.367946 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368441 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368574 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368662 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.368951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.369886 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370037 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370268 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370640 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.370886 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.371101 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.371240 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.371411 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.371552 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.371695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372198 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372348 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372485 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372622 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.372903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.373230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.373383 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.373535 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.373764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.374067 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.374212 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.374400 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.374540 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.374710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.374842 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.375019 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.375158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.375328 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.375471 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.375637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.375794 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376036 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376178 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376466 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376751 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.376894 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377036 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377320 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377467 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.377888 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378176 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378324 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378617 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378758 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.378902 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379037 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379504 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379816 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.379989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.380154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.380324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.380462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.380607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.380761 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.380907 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381195 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381656 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.381965 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.382112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.382258 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.382392 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.382602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.382811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.382966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.383116 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.383277 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.383423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.383560 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.383701 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.383839 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.384041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.384194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.384329 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.384472 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.384606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.384740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.384883 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.385036 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.385170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.385305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.385440 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.385655 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.385858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.386019 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.386171 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.386313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.386449 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.386600 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.386752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.386896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.387031 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.387166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.387302 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.387451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.387593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.387727 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.387902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.388038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.388176 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.388364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.388515 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.388652 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.388852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.389015 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.389640 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.389926 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.390063 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.390251 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.390404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.390547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.390648 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.390889 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.391057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.391199 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.391300 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.391495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.391645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.391755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.391850 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.392137 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:55:48.392290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.392476 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.392625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.392810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.392946 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.393155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.393301 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.393451 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.393567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.393767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.393869 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.394120 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.394269 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.394440 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.394590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.394720 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.394820 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.395064 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.395201 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.395370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.395476 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.395683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.395787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.396965 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.397059 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.397275 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.397381 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.397589 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.397684 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.397903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398007 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398224 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.398952 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.399699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.399854 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400130 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400239 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.400913 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401583 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.401934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402164 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402475 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402630 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402785 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.402969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.403127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.403284 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.403435 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.403607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.403805 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.403955 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.404150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.404264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.404578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.404766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.404965 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405331 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405467 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405596 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405736 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.405919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.406131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.406274 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.406449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.406566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.406772 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407126 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407267 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407396 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407575 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407679 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.407919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.408065 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.408166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.408351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.408697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.408848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.408987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409490 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409573 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409654 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.409923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.410147 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.410244 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.410488 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.410598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.410806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.410952 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.411127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.411248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.411444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.411542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.411760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.411999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.412141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.412266 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.412981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413118 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413209 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413302 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413477 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413569 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413839 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.413923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414240 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414464 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.414853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.415066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.415214 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.415377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.415470 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.415684 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.415856 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.416065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.416158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.416652 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.416855 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417218 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417312 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417531 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.417986 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.418068 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.418210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.418306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.418697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.418832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.418975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419165 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419336 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419704 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.419810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.420093 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.420341 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.420454 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.420697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.420909 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421011 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421563 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.421985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.422192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.422289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.422503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.422592 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.422832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.422992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.423144 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.423231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.423449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.423539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.423757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.423854 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.424089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.424179 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.424432 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.424528 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.424739 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.424830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.425073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.425162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.425399 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.425489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.425711 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.425853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426028 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426341 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.426963 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.427080 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.427278 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.427383 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.427593 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.427683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.427921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428242 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.428973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.429186 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.429286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.429503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.429648 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.429808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.429971 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.430124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.430297 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.430453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.430607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.430790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.430916 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.431103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.431262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.431417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.431599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.431741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.431940 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.432089 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.432272 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.432402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.432589 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.432712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.432907 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433010 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433222 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433849 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.433948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.434163 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.434254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.434488 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.434585 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.434793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.434891 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.435112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.435209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.435422 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.435513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.435774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.435920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.436112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.436439 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.436607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.436749 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.436932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.437067 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.437321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.437424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.437582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.437724 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.437914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.438039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.438241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.438356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.438552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.438683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.438861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439500 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.439951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.440142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.440261 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.440448 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.440575 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.440813 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.440948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.441106 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.441204 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.441413 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.441581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.441731 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.441854 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442177 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.442989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.443100 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.443300 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.443427 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.443622 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.443735 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444326 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.444887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.445031 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.445177 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.445332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.446460 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.446638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.446774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.446872 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.446968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447320 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447638 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447722 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.447924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448388 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448570 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448726 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.448885 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.449261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.449421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.449566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.449811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.449943 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450054 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450160 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450266 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450485 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450604 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.450940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.451046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.451298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.451508 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.451836 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.452167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.452270 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.452488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.452597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.452803 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.452903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.453115 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.453207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.453424 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.453523 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.453733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.453846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.454040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.454155 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.454352 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.454614 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.454712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.454951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455413 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455665 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.455995 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.456265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.456367 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.456521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.456612 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.456827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.456924 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.457150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.457249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.457465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.457695 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.457804 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.457889 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458060 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458677 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.458986 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.459083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.459296 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.459394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.459605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.459697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.459941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460252 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460354 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460561 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460705 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460865 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.460959 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.461174 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.461334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.461491 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.461582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.461794 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.461883 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.462105 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.462207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.462412 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.462510 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.462716 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.462813 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463029 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463737 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.463966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464072 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464370 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464585 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464892 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.464992 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.465209 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.465298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.465521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.465620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.465826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.465960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.466129 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.466245 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.466444 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.466577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.466747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.466872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.467148 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.467431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.467563 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.467750 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.467925 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.468086 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.468210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.468395 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.468531 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.468711 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469396 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469502 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469590 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469664 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469758 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.469905 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.470042 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.470350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.470679 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.470806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.470990 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.471084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.471298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.471410 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.471606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.471717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.471945 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472365 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472558 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472870 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.472967 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.473184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.473288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.473608 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.473927 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.474239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.474565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.474878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.475189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.475499 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.475814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.476155 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.476489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.476807 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.477121 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.477430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.477738 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.478053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.478359 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.478666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.478978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.479305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.479626 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.479962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.480222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.480333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.480574 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.480671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.480903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.481032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.481185 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.481328 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.481549 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.481797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.481903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.482161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.482262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.482418 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.482571 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.482780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.482878 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.483094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.483191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.483406 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.483655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.483766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484061 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484159 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484370 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.484990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.485094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.485308 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.485413 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.485619 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.485716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.485973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.486070 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.486284 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.486396 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.486629 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.486729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.486930 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.487084 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.487329 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.487488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.487630 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.487797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488205 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488500 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488665 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.488951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.489101 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.489258 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.489401 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.490110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.490276 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.490422 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.490565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.490716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.490860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.491090 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.491265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.491537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.491708 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.491867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.492046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.492200 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.492200 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.492585 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.492728 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.492884 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493036 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493181 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493341 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493491 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493648 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.493941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494833 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.494975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.495127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.495127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.495627 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.495787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.495981 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.496132 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.496276 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.496426 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.496583 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.496780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.496928 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.497079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.497231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.497490 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.497666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.497817 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.498180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.498180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.498463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.498625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.498783 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.498983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.499140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.499283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.499436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.499588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.499742 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.499920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500070 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500212 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500666 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.500956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.501123 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.501361 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.501530 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.501749 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.501917 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.502069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.502218 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.502375 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.502622 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.502772 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.502914 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503056 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503198 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503500 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503644 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503793 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.503985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.504131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.504282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.504433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.504586 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.504729 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.504872 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.505023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.505165 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.505314 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.505456 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.505692 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.505853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506021 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506172 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506615 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.506924 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.507075 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.507225 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.507367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.507532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.507770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.507973 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.508134 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.508368 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.508519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.508670 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.508826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.508970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509414 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509563 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509563 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.509998 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.510146 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.510298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.510439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.510590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.510732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.510888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.511040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.511203 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.511374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.511588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.511763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.512030 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.512204 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.512363 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.512506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.512673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.512904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.513066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.513254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.513411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.513564 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.514037 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.514529 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.514748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.514934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.515089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.515243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.515389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.515540 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.515710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.515967 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.516118 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.516271 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.516421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.516566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.517076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.517241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.517403 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.517548 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.517690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.517935 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.518085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.518085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.518403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.518621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.518779 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.518930 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.519152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.519306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.519458 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.519618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.519769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.519941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.520104 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.520249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.520393 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.520542 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.521286 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.521443 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.521622 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.521843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.522021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.522242 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.522410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.522555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.522714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.522857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.523104 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.523254 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.523407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.523565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.523708 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.523850 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524061 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524204 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524841 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.524992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.525141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.525291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.525442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.525596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.525749 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.525908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.526129 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.526285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.526449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.526593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.526787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.526984 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.527140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.527299 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.527449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.527605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.527756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.528033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.528203 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.528363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.528513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.528513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.528916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.529068 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.529224 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.529453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.529643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.529856 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.530958 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.531115 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.531280 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.531441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.531599 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.531748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.532049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.532226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.532226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.532603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.532760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.532909 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.533247 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.533406 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.533406 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.533707 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.533863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.534014 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.534163 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.534312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.534471 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.534950 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.535117 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.535266 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.535424 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.535597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.535748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.535937 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.536131 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.536365 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.536522 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.536522 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.536821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.536977 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.537133 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.537290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.537439 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.537602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.537771 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.537771 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.538069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.538226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.538480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.538652 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.538892 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.539056 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.539206 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.539362 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.539521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.539670 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.539862 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.540076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.540227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.540378 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.540539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.540697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.540855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541153 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541153 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541461 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.541926 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.542174 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.542338 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.542582 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.542739 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.542895 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.543044 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.543228 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.543489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.543648 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.543648 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.543983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.544137 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.544327 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545021 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545209 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545522 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545831 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.545996 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.546148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.546304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.546553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.546711 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.546886 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.547037 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.547202 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.547353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.547509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.547667 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.547830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.548004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.548166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.548316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.548494 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.548759 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549024 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549182 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549339 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.549957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.550107 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.550256 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.550544 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.550713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.550881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.551045 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.551203 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.551364 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.551522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.551754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.551951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.552108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.552353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.552508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.552753 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.552926 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.553078 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.553246 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.553403 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.553664 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.553820 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.553981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.554139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.554297 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.554466 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.554624 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.554788 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.554788 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.555072 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.555072 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.555374 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.555524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.555681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.555838 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.556045 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.556194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.556342 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.556501 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.557280 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.557446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.557597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.557746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.557914 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.558075 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.558235 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.558235 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.558526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.558676 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.558934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.559193 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.559360 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.559511 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.559660 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.559808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.560013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.560974 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.561157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.561322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.561480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.561640 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.561791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.561950 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.562107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.562258 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.562509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.562509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.562908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.563086 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.563236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.563394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.563551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.563709 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.563910 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.564070 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.564230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.564504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.564669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.564827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.564987 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.565145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.565316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.565316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.565611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.565760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.565923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.566073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.566230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.566390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.566542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.566700 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.566947 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.567103 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.567103 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.567398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.567398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.567702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.567702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.568073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.568233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.568384 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.568532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.568695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.568695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.569106 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.569368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.569538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.569697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.569856 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570155 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570304 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570769 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.570927 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.571076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.571231 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.571384 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.571552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.571709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.571912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.572079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.572229 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.572377 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.572552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.572789 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.573042 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.573217 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.573377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.573526 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.573689 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.573857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.574007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.574156 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.574335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.574516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.574760 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.574926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.575084 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.575234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.575474 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.575641 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.575807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.576005 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.576219 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.576421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.576632 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.576797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.576973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.577207 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.577402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.577560 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.577710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.577873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578646 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578806 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.578963 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.579140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.579404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.579638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.579802 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580031 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580484 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580807 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.580964 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581692 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581842 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.581991 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.582146 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.582305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.582468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.582629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.582796 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.583036 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.583269 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.583436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.583601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.583750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.583928 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.584083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.584245 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.584403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.584627 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.584811 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.585058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.585222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.585372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.585532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.585682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.585847 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586154 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.586764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.587061 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.587227 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.587462 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.587619 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.587776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.587947 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.588112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.588262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.588421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.588580 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.588769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.588943 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.589094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.589252 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.589430 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.589758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.589915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.590072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.590222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.590387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.590540 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.590690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.590877 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.591032 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.591208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.591376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.591534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.591704 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.591983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.592152 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.592314 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.592314 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.592697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.592697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.593020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.593020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.593523 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.593687 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.593846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.593846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.594130 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.594279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.594441 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.594598 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.594758 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.594917 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.595085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.595347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.595515 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.595672 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.595829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596476 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.596932 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597089 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597247 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597404 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597814 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.597975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.598438 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.598597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.598756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.598914 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.599064 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.599231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.599381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.599538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.599920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.600098 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.600251 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.600411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.600575 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.600734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.600885 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.601034 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.601184 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.601367 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.601519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.601679 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.601837 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602168 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602476 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602632 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602782 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.602930 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.603088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.603264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.603511 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.603732 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.603905 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.604071 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.604244 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.604406 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.604556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.604704 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.604863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.605013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.605171 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.605339 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.605576 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.605740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.605898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.606057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.606215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.606383 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.606541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.606690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.606846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.607004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.607154 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.607310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.607497 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.607671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.607958 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.608130 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.608290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.608452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.608608 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.608758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.608758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.609054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.609212 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.609369 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.609527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.609676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.609856 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.610172 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.610330 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.610489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.610652 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.610809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.610968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.611118 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.611285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.611445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.611596 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.611746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.611933 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.612091 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.612247 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.612396 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.612556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.612720 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.612871 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.613020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.613168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.613317 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.613486 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.613775 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.614042 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.614207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.614359 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.614510 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.614952 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.615140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.615293 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.615514 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.615973 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.616161 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.616404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.616560 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.616719 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.616887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.617097 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.617257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.619145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.625600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.625934 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.626113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.626277 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.626436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.626607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.626762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.627758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.627993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628159 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628336 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628499 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628682 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.628989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.629296 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.629449 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.629599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.629747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.629904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.629904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.630201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.631347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.631347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.631347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.631347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:55:48.631347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:55:48.764746 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO dbcounter [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Registered counter for database nova_api Jul 14 10:55:48.774044 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO dbcounter [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Registered counter for database nova_api Jul 14 10:55:48.785219 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_db.sqlalchemy.engines [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:48.792377 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writer thread running {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:48.794925 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_db.sqlalchemy.engines [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:48.802541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writer thread running {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:48.849222 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.context [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f81cba64-582e-4504-8b43-6c2a9f412413(cell1) {{(pid=133221) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:55:48.853360 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:55:48.854958 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:55:48.855779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:55:48.857850 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:55:48.859943 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO dbcounter [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Registered counter for database nova_cell0 Jul 14 10:55:48.860307 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.context [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f81cba64-582e-4504-8b43-6c2a9f412413(cell1) {{(pid=133220) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:55:48.864089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO dbcounter [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Registered counter for database nova_cell1 Jul 14 10:55:48.864453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:55:48.866013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:55:48.866856 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:55:48.868852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:55:48.871057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO dbcounter [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Registered counter for database nova_cell0 Jul 14 10:55:48.871351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_db.sqlalchemy.engines [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:48.872563 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_db.sqlalchemy.engines [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:48.876072 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO dbcounter [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Registered counter for database nova_cell1 Jul 14 10:55:48.878942 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writer thread running {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:48.881494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writer thread running {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:48.883935 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_db.sqlalchemy.engines [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:48.886208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_db.sqlalchemy.engines [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:48.892483 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writer thread running {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:48.895118 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writer thread running {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:49.030351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO dbcounter [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Registered counter for database nova_cell0 Jul 14 10:55:49.037457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_db.sqlalchemy.engines [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:49.042118 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writer thread running {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:49.046236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO dbcounter [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Registered counter for database nova_cell0 Jul 14 10:55:49.053117 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_db.sqlalchemy.engines [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:55:49.057851 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writer thread running {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:55:49.358424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: WARNING keystonemiddleware.auth_token [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:55:49.365832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: WARNING keystonemiddleware.auth_token [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:55:49.415344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: WARNING keystonemiddleware.auth_token [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:55:49.422717 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: WARNING keystonemiddleware.auth_token [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:55:49.708823 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: WARNING keystonemiddleware.auth_token [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:55:49.714922 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: WARNING keystonemiddleware.auth_token [None req-38221702-9fcc-4283-9315-9f1cad7b3293 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:55:49.721315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562014f359c0 pid: 133221 (default app) Jul 14 10:55:49.774743 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: WARNING keystonemiddleware.auth_token [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:55:49.781418 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: WARNING keystonemiddleware.auth_token [None req-446aa3df-eaa9-4523-a3be-0811cb902040 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:55:49.787829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562014f359c0 pid: 133220 (default app) Jul 14 10:56:30.838382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:30.842832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:30.843998 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:30.844881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:31.476520 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:31.477651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:31.478630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:31.479405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:32.603038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3a58154b-49da-4353-a8a0-4c3071c2bef0 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Action: 'create', calling method: .version_select at 0x7f13d6460ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-328306095", "metadata": {"Type": "work"}}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:32.880807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-76ec458c-ef21-4e58-b641-ff64d1c857af tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Action: 'create', calling method: .version_select at 0x7f13d63eec10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037644018", "metadata": {"Type": "work"}}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-76ec458c-ef21-4e58-b641-ff64d1c857af tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Request method failure captured: Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 122 Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZfkKOanDxlI5wCEgm8QrL_1wEZnKGqrkJQXGW6gqEqOXbVwWG9F92C9sCGUUnbbekVxh8wXyWKLMGS3VnxdpFsY_BVAHhH10o8DytWBvDsSMkfamq0vQK7wHx89k-m2cb9ePOSkgOde69hrjWHq0Z-0w0I4pg90UCBuWJ9Giyu5aw Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:32.902934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bee9d276e8894710aa906773baa327e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bee9d276e8894710aa906773baa327e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a99ca7f13e29411c91b606f59e635121 Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037644018", "metadata": {"Type": "work"}}} Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:32.904809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037644018', 'metadata': {'Type': 'work'}}}} Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise error Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:32.905951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 10:56:32.907914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 10:56:32.910394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 10:56:32.910394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.923428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-76ec458c-ef21-4e58-b641-ff64d1c857af tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:32.926231 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-76ec458c-ef21-4e58-b641-ff64d1c857af tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.459051 Jul 14 10:56:32.936512 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 10:56:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1472 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:56:32.951100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-893ba597-8379-443d-8e99-b805c7bfa5f8 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Action: 'create', calling method: .version_select at 0x7f13d640eee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1413621104", "metadata": {"Type": "work"}}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-893ba597-8379-443d-8e99-b805c7bfa5f8 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Request method failure captured: Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 120 Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZfkKOanDxlI5wCEgm8QrL_1wEZnKGqrkJQXGW6gqEqOXbVwWG9F92C9sCGUUnbbekVxh8wXyWKLMGS3VnxdpFsY_BVAHhH10o8DytWBvDsSMkfamq0vQK7wHx89k-m2cb9ePOSkgOde69hrjWHq0Z-0w0I4pg90UCBuWJ9Giyu5aw Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:32.960208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bee9d276e8894710aa906773baa327e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bee9d276e8894710aa906773baa327e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a99ca7f13e29411c91b606f59e635121 Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1413621104", "metadata": {"Type": "work"}}} Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:32.961999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1413621104', 'metadata': {'Type': 'work'}}}} Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise error Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi '0' Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:32.962954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 10:56:32.964534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 10:56:32.966691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 10:56:32.966691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:32.969719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-893ba597-8379-443d-8e99-b805c7bfa5f8 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:32.972750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-893ba597-8379-443d-8e99-b805c7bfa5f8 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033341 Jul 14 10:56:32.982973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 10:56:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:56:32.998184 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-312a7502-3530-43ad-9e10-4ac8bc9eaff1 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Action: 'create', calling method: .version_select at 0x7f13d640e0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1911283798", "metadata": {"Type": "work"}}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-312a7502-3530-43ad-9e10-4ac8bc9eaff1 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Request method failure captured: Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 119 Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZfkKOanDxlI5wCEgm8QrL_1wEZnKGqrkJQXGW6gqEqOXbVwWG9F92C9sCGUUnbbekVxh8wXyWKLMGS3VnxdpFsY_BVAHhH10o8DytWBvDsSMkfamq0vQK7wHx89k-m2cb9ePOSkgOde69hrjWHq0Z-0w0I4pg90UCBuWJ9Giyu5aw Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:33.004904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bee9d276e8894710aa906773baa327e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bee9d276e8894710aa906773baa327e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a99ca7f13e29411c91b606f59e635121 Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1911283798", "metadata": {"Type": "work"}}} Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:33.006504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1911283798', 'metadata': {'Type': 'work'}}}} Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise error Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi '' Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:33.007425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 10:56:33.009047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 10:56:33.011298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 10:56:33.011298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:33.011298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-312a7502-3530-43ad-9e10-4ac8bc9eaff1 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:33.011298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-312a7502-3530-43ad-9e10-4ac8bc9eaff1 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023382 Jul 14 10:56:33.011298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 10:56:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:56:33.018404 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-16f98818-54a7-4c6e-8c05-b3ac1a3ba91e tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Calling method '.version_select at 0x7f13d631dca0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:34.448363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-16f98818-54a7-4c6e-8c05-b3ac1a3ba91e tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] HTTP exception thrown: Volume tempest-invalid-1545722292 could not be found. Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-16f98818-54a7-4c6e-8c05-b3ac1a3ba91e tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Request method failure captured: Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1545722292 HTTP/1.1 Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZfkKOanDxlI5wCEgm8QrL_1wEZnKGqrkJQXGW6gqEqOXbVwWG9F92C9sCGUUnbbekVxh8wXyWKLMGS3VnxdpFsY_BVAHhH10o8DytWBvDsSMkfamq0vQK7wHx89k-m2cb9ePOSkgOde69hrjWHq0Z-0w0I4pg90UCBuWJ9Giyu5aw Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:34.453651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bee9d276e8894710aa906773baa327e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bee9d276e8894710aa906773baa327e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a99ca7f13e29411c91b606f59e635121 Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume tempest-invalid-1545722292 could not be found. Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'tempest-invalid-1545722292'} Jul 14 10:56:34.455472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1545722292 could not be found. (HTTP 404) (Request-ID: req-26381c89-dc79-4a87-acf7-3addba1addec) Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:34.456397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:56:34.457864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1545722292 could not be found. Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:56:34.459282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1545722292 could not be found. Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1545722292 could not be found. Jul 14 10:56:34.460802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.463101 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-16f98818-54a7-4c6e-8c05-b3ac1a3ba91e tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Returning 404 to user: Volume tempest-invalid-1545722292 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:34.464413 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-16f98818-54a7-4c6e-8c05-b3ac1a3ba91e tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1545722292" status: 404 len: 99 microversion: 2.1 time: 1.450891 Jul 14 10:56:34.471732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 10:56:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1545722292 => generated 99 bytes in 1459 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 10:56:34.490371 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-98152431-f208-4686-a378-e7e53cbe1e4b tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011434 Jul 14 10:56:34.492677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jul 14 10:56:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 10:56:34.503005 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-944db481-6005-4d42-83dc-af9699010f0d tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003824 Jul 14 10:56:34.503524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jul 14 10:56:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 10:56:34.514328 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cb7cf9ed-4387-4ef8-9e0a-abc6c3a5df04 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Calling method '.version_select at 0x7f13d6239f70>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:34.864447 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-cb7cf9ed-4387-4ef8-9e0a-abc6c3a5df04 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] HTTP exception thrown: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cb7cf9ed-4387-4ef8-9e0a-abc6c3a5df04 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Request method failure captured: Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/os-volumes/0790a9d3-b8eb-4c86-a976-61f0e78ac847 HTTP/1.1 Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZfkKOanDxlI5wCEgm8QrL_1wEZnKGqrkJQXGW6gqEqOXbVwWG9F92C9sCGUUnbbekVxh8wXyWKLMGS3VnxdpFsY_BVAHhH10o8DytWBvDsSMkfamq0vQK7wHx89k-m2cb9ePOSkgOde69hrjWHq0Z-0w0I4pg90UCBuWJ9Giyu5aw Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:34.866738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bee9d276e8894710aa906773baa327e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bee9d276e8894710aa906773baa327e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a99ca7f13e29411c91b606f59e635121 Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '0790a9d3-b8eb-4c86-a976-61f0e78ac847'} Jul 14 10:56:34.868079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. (HTTP 404) (Request-ID: req-41351387-8e09-4b50-95b1-ca603df83478) Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:34.869011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:56:34.870100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 10:56:34.871273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. Jul 14 10:56:34.872402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:34.874890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cb7cf9ed-4387-4ef8-9e0a-abc6c3a5df04 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Returning 404 to user: Volume 0790a9d3-b8eb-4c86-a976-61f0e78ac847 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:34.876015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cb7cf9ed-4387-4ef8-9e0a-abc6c3a5df04 tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/0790a9d3-b8eb-4c86-a976-61f0e78ac847" status: 404 len: 109 microversion: 2.1 time: 0.367350 Jul 14 10:56:34.877379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 7/7] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 10:56:34 2022] DELETE /compute/v2.1/os-volumes/0790a9d3-b8eb-4c86-a976-61f0e78ac847 => generated 109 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:34.886406 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-38a77c13-bd6b-4ff5-9adb-0cdd7cf7ca1d tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Calling method '.version_select at 0x7f13d6239f70>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:34.971207 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3a58154b-49da-4353-a8a0-4c3071c2bef0 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.148825 Jul 14 10:56:34.971854 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 1/8] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 10:56:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4151 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 10:56:34.985447 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f119df0a-7640-42c1-9f08-e0c747b06b33 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Calling method '.version_select at 0x7f13d62baaf0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:35.035074 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-38a77c13-bd6b-4ff5-9adb-0cdd7cf7ca1d tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] HTTP exception thrown: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-38a77c13-bd6b-4ff5-9adb-0cdd7cf7ca1d tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Request method failure captured: Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/os-volumes/34469c3d-679b-473a-ae15-99e347c3a76e HTTP/1.1 Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZfkKOanDxlI5wCEgm8QrL_1wEZnKGqrkJQXGW6gqEqOXbVwWG9F92C9sCGUUnbbekVxh8wXyWKLMGS3VnxdpFsY_BVAHhH10o8DytWBvDsSMkfamq0vQK7wHx89k-m2cb9ePOSkgOde69hrjWHq0Z-0w0I4pg90UCBuWJ9Giyu5aw Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:35.037002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bee9d276e8894710aa906773baa327e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bee9d276e8894710aa906773baa327e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bee9d276e8894710aa906773baa327e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: bee9d276e8894710aa906773baa327e3 Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-511620612 Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a99ca7f13e29411c91b606f59e635121 Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-511620612-project Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '34469c3d-679b-473a-ae15-99e347c3a76e'} Jul 14 10:56:35.038557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. (HTTP 404) (Request-ID: req-13fe9484-f677-4e78-ab2c-3b982476af41) Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:35.039473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:56:35.041629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 10:56:35.044248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-38a77c13-bd6b-4ff5-9adb-0cdd7cf7ca1d tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] Returning 404 to user: Volume 34469c3d-679b-473a-ae15-99e347c3a76e could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-38a77c13-bd6b-4ff5-9adb-0cdd7cf7ca1d tempest-VolumesNegativeTest-511620612 tempest-VolumesNegativeTest-511620612-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34469c3d-679b-473a-ae15-99e347c3a76e" status: 404 len: 109 microversion: 2.1 time: 0.155548 Jul 14 10:56:35.047688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 8/9] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 10:56:34 2022] GET /compute/v2.1/os-volumes/34469c3d-679b-473a-ae15-99e347c3a76e => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:56:35.117972 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f119df0a-7640-42c1-9f08-e0c747b06b33 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd" status: 200 len: 352 microversion: 2.1 time: 0.137572 Jul 14 10:56:35.118539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 2/10] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 10:56:34 2022] GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:56:36.130530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-250f02bb-9241-4c4c-9cf1-a9ff6da08fd3 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Calling method '.version_select at 0x7f13d6253940>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:36.254096 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-250f02bb-9241-4c4c-9cf1-a9ff6da08fd3 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd" status: 200 len: 353 microversion: 2.1 time: 0.127260 Jul 14 10:56:36.261225 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 9/11] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 10:56:36 2022] GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:56:36.271512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1c901636-a6ec-428b-83b4-d9bce9356591 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Calling method '.version_select at 0x7f13d62bac10>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:36.413968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1c901636-a6ec-428b-83b4-d9bce9356591 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd" status: 200 len: 353 microversion: 2.1 time: 0.151587 Jul 14 10:56:36.414544 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 3/12] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 10:56:36 2022] GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:56:36.431217 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cb01d122-75bb-4e43-805b-e102f679d901 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Calling method '.version_select at 0x7f13d6239ca0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:36.550390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cb01d122-75bb-4e43-805b-e102f679d901 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd" status: 202 len: 0 microversion: 2.1 time: 0.122798 Jul 14 10:56:36.552933 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 10/13] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 10:56:36 2022] DELETE /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:56:36.567315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b6b4c0dc-6954-4309-9315-7b835d589db5 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Calling method '.version_select at 0x7f13d62d6280>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:36.636735 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b6b4c0dc-6954-4309-9315-7b835d589db5 tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd" status: 200 len: 352 microversion: 2.1 time: 0.079898 Jul 14 10:56:36.638160 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 4/14] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 10:56:36 2022] GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:56:37.651572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d7badfc1-3825-4492-978c-ab2e2583c73b tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Calling method '.version_select at 0x7f13d6253dc0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:38.086361 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-d7badfc1-3825-4492-978c-ab2e2583c73b tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] HTTP exception thrown: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d7badfc1-3825-4492-978c-ab2e2583c73b tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Request method failure captured: Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd HTTP/1.1 Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZenqOg0CxQgEcUWTuaKxmG4s2-WrIOp1zzRWUnVkysE-dczbhdhqXszz-etLMiaF3C5AVzSTfaiK8wF50MPoC1fd0HUp4jddDXYQ7zEVkqrWiTPqRrcBKW96wOPlZe109y76ZuS2s-5URXURTtQnjOcx_fHLGq1PznlpDpMc9MalM Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 9ea25562cd9b44dfa599d3a8c3b1f324 Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesGetTestJSON-1266447100 Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:56:38.094879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea25562cd9b44dfa599d3a8c3b1f324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea25562cd9b44dfa599d3a8c3b1f324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea25562cd9b44dfa599d3a8c3b1f324"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea25562cd9b44dfa599d3a8c3b1f324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesGetTestJSON-1266447100 Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 9ea25562cd9b44dfa599d3a8c3b1f324 Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesGetTestJSON-1266447100 Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesGetTestJSON-1266447100-project Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 240c18e4ef65400eb55abde15424b819 Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesGetTestJSON-1266447100-project Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd'} Jul 14 10:56:38.096211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. (HTTP 404) (Request-ID: req-730989e0-72cc-4699-8b27-d87d0cb4f484) Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:38.097311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:56:38.098397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 10:56:38.099565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. Jul 14 10:56:38.100732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:56:38.104520 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d7badfc1-3825-4492-978c-ab2e2583c73b tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] Returning 404 to user: Volume bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:56:38.108195 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d7badfc1-3825-4492-978c-ab2e2583c73b tempest-VolumesGetTestJSON-1266447100 tempest-VolumesGetTestJSON-1266447100-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd" status: 404 len: 109 microversion: 2.1 time: 0.461047 Jul 14 10:56:38.109173 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 11/15] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 10:56:37 2022] GET /compute/v2.1/os-volumes/bc2c505a-4f9d-4354-8fd9-1ac4dd7ecbbd => generated 109 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:43.723920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-429a92e5-941f-4983-b8d5-a019c8cfd716 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: .version_select at 0x7f13d62d6820>, body: {"keypair": {"name": "tempest-keypair-1775615387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCc1Uq5K7OSC3xwdYT0VZZ4FHp6Z6vzaazeC7QZIeY70AEPP1LAfPzF1TBiluQVXnFZz6DPYScs3HbrcZw89i/1ey34Ww9v+kDsVs97wuv81gVhr1zl1wzNASDFLTHQkg=="}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:43.760501 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1134384132", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "networks": [{"uuid": "4d099017-0c0c-43fd-80a2-c16ac688b960"}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:43.861847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-429a92e5-941f-4983-b8d5-a019c8cfd716 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for project a3160540122441ce970560d7a3db2521. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:43.876990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-429a92e5-941f-4983-b8d5-a019c8cfd716 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for user 6ead76e4f3564d6eb614bb911ccaf674 and project a3160540122441ce970560d7a3db2521. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:44.055605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] validate_networks() for [('4d099017-0c0c-43fd-80a2-c16ac688b960', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:56:44.070704 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-429a92e5-941f-4983-b8d5-a019c8cfd716 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.111463 Jul 14 10:56:44.080891 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 5/16] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 10:56:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:56:48.447832 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:56:48.448351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:56:48.448683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:56:48.450065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:56:48.450681 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:56:48.529979 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:48.529979 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:48.532415 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:48.535350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:48.641029 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Getting quotas for project 5dcd3b32ea75463c95bb2d451c59cdd1. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:48.651944 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Getting quotas for user 5cc60574eb7f4df6b193c244973ed8c3 and project 5dcd3b32ea75463c95bb2d451c59cdd1. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:48.690609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:56:48.702380 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:56:48.909465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d09ec747-5db1-4b25-afc9-9a37a11f91ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.649611 Jul 14 10:56:48.926115 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-13adb5f9-4f13-48b9-a1c6-8323084efe63 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:48.926887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-13adb5f9-4f13-48b9-a1c6-8323084efe63 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:48.930681 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 12/17] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 5671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:56:49.258860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-13adb5f9-4f13-48b9-a1c6-8323084efe63 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:49.291472 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-13adb5f9-4f13-48b9-a1c6-8323084efe63 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1215 microversion: 2.1 time: 0.369106 Jul 14 10:56:49.300061 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 6/18] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:48 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1215 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:49.336488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ce5bee56-3c51-4b9e-9356-daba2c0ea5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'create', calling method: .version_select at 0x7f13d6142a60>, body: {"keypair": {"name": "tempest-keypair-1009447417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIge5yGC9XdKKa5Ynv55DljIjYpwUpQi8Vtws/8rA1BFHnC04rDORxPq5/XgrN/AH452dtmenCSBgBcR+TRLUK2hv5gbaaF0LHSq1ML6QR5ioE22Ts1fQXa0R8OhSnrHw=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:49.385897 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-ce5bee56-3c51-4b9e-9356-daba2c0ea5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for project 2ff1f327753b4708b0940964aa3d761c. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:49.399249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-ce5bee56-3c51-4b9e-9356-daba2c0ea5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for user 3e4012911dad42edbffead00e0fd55e6 and project 2ff1f327753b4708b0940964aa3d761c. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:49.494459 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ce5bee56-3c51-4b9e-9356-daba2c0ea5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.515827 Jul 14 10:56:49.496031 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 13/19] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jul 14 10:56:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 518 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 10:56:50.223085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-336729936", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:50.309016 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2b5be510-3ffe-4205-b868-7d90a330a20f tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:50.310188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2b5be510-3ffe-4205-b868-7d90a330a20f tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:50.460729 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] validate_networks() for [('eae5d0eb-0b14-432c-84e3-b58be5ccf17f', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:56:50.909381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2b5be510-3ffe-4205-b868-7d90a330a20f tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:50.929026 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2b5be510-3ffe-4205-b868-7d90a330a20f tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1215 microversion: 2.1 time: 0.624134 Jul 14 10:56:50.949235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 14/20] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:50 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1215 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:56:51.936630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1480780822", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6d52b3c-ba6d-4280-906d-b963886d7469"}], "security_groups": [{"name": "tempest-securitygroup--496991368"}], "key_name": "tempest-keypair-1775615387", "user_data": "}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:52.866478 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] validate_networks() for [('d6d52b3c-ba6d-4280-906d-b963886d7469', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:56:53.657837 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:56:53.658435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:56:53.659962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:56:53.660433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:56:53.660958 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:56:53.684490 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:53.689897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:53.690990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:53.693536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:53.772407 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for project c2d5301114244be2a74210484c6536ef. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:53.782577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for user b47991b6880c4a91ab42d2567eee61aa and project c2d5301114244be2a74210484c6536ef. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:53.809944 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:56:53.817535 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:56:53.907062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:56:53.907561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:56:53.908255 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:56:53.909507 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:56:53.925122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:56:53.932483 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0d80c59d-3d30-435d-833b-637e1407bdde tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.855311 Jul 14 10:56:53.935049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 7/21] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:56:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:56:53.961761 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:53.963285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:53.968610 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:53.971916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:53.973141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:53.978673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:53.991787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:53.995209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:53.996844 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:54.001675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:54.063800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for project a3160540122441ce970560d7a3db2521. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:54.081544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for user 6ead76e4f3564d6eb614bb911ccaf674 and project a3160540122441ce970560d7a3db2521. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:54.123230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:56:54.128868 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:56:54.289353 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6fcee822-9815-43c5-a737-8785bf063b5c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.354965 Jul 14 10:56:54.292420 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 15/22] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:56:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:56:54.305738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cbb0161d-d264-49c7-b81f-a3250b90c25a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:54.312807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-cbb0161d-d264-49c7-b81f-a3250b90c25a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:54.493716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:54.526776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f419279d-2431-4690-bf3f-422ea9150e01 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1267 microversion: 2.1 time: 0.584900 Jul 14 10:56:54.542912 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 8/23] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:53 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1267 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:54.566276 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b47156db-9347-4f53-a14e-7f00bff7ddd0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:54.567721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b47156db-9347-4f53-a14e-7f00bff7ddd0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:54.589371 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cbb0161d-d264-49c7-b81f-a3250b90c25a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:54.598143 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cbb0161d-d264-49c7-b81f-a3250b90c25a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1221 microversion: 2.1 time: 0.304413 Jul 14 10:56:54.606946 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 16/24] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:54 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1221 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:54.793939 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b47156db-9347-4f53-a14e-7f00bff7ddd0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:54.804432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b47156db-9347-4f53-a14e-7f00bff7ddd0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1238 microversion: 2.1 time: 0.259378 Jul 14 10:56:54.809343 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 9/25] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:54 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1238 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:54.947264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-447288262", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:55.032789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] validate_networks() for [('eae5d0eb-0b14-432c-84e3-b58be5ccf17f', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:56:55.178148 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-241403746", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24b72f21-647f-469a-9422-b0123813b1a7"}], "security_groups": [{"name": "tempest-securitygroup--139993734"}], "key_name": "tempest-keypair-1009447417", "user_data": "}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:56:55.487038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] validate_networks() for [('24b72f21-647f-469a-9422-b0123813b1a7', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:56:56.760379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:56:56.760838 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:56:56.761257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:56:56.761671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:56:56.762091 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:56:56.783770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:56.786027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:56.788639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:56.793000 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:56.879166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for project c2d5301114244be2a74210484c6536ef. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:56.890945 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for user b47991b6880c4a91ab42d2567eee61aa and project c2d5301114244be2a74210484c6536ef. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:56.962726 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:56:56.965287 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:56:57.089911 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5cd97cd4-3142-4496-b7b7-8f989ca0980e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.154768 Jul 14 10:56:57.097600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 17/26] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:56:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:56:57.104864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:57.105786 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:57.114918 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:57.115705 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:57.116874 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:57.118176 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:57.641700 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:57.668146 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f7c834ae-8ce8-47e0-8797-6e47b21b5567 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1273 microversion: 2.1 time: 0.567865 Jul 14 10:56:57.672417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 18/27] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:57 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1273 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:57.695826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:57.696702 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:57.703997 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:57.704652 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:57.705573 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:57.706150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:58.320265 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:56:58.321423 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:56:58.322112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:56:58.322730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:56:58.323543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:56:58.342540 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:58.354338 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:58.355575 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:58.358497 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:58.452654 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for project 2ff1f327753b4708b0940964aa3d761c. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:56:58.476408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for user 3e4012911dad42edbffead00e0fd55e6 and project 2ff1f327753b4708b0940964aa3d761c. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:56:58.517862 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:58.528838 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:56:58.535418 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-82f9ddf4-9013-4903-aa3b-b8e4bf820abc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1298 microversion: 2.1 time: 0.852117 Jul 14 10:56:58.550487 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 19/28] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:57 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1298 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:58.553771 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:56:58.557921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:58.559547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:58.574764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:58.580402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:58.581574 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:58.582248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:58.725931 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ef8d6291-b68b-4ec9-8a32-c4240eaab5f5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.554504 Jul 14 10:56:58.736364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 10/29] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jul 14 10:56:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 3566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 10:56:58.762567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:58.765672 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:58.790990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:58.792833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:58.795197 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:56:58.797111 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:56:59.791268 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:59.826218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-53a6b214-44cd-46d4-a327-86f190641376 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1217 microversion: 2.1 time: 1.273835 Jul 14 10:56:59.826861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 20/30] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:58 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1217 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:59.874729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-18666896-df3d-4987-b39e-e5564413c992 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:59.875368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-18666896-df3d-4987-b39e-e5564413c992 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:56:59.943243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:56:59.950858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c480064a-fba6-4c17-9925-f6ead02cefc2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1273 microversion: 2.1 time: 1.208224 Jul 14 10:56:59.959028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 11/31] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:58 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1273 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:56:59.991460 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:56:59.997447 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:00.035414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:00.036376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:00.037383 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:00.053520 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:00.304823 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:00.313440 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-90d505e7-564f-499a-af35-fb9e985498a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1296 microversion: 2.1 time: 0.353127 Jul 14 10:57:00.321613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 12/32] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:56:59 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1296 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:00.576450 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18666896-df3d-4987-b39e-e5564413c992 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:00.585195 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18666896-df3d-4987-b39e-e5564413c992 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:00.601142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18666896-df3d-4987-b39e-e5564413c992 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:00.608711 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-18666896-df3d-4987-b39e-e5564413c992 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1281 microversion: 2.20 time: 0.755323 Jul 14 10:57:00.620790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 21/33] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:56:59 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1281 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:00.842787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:00.843599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:00.854663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:00.866385 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:00.868847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:00.869527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:00.978032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:00.978810 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:01.004438 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:01.005379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:01.006610 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:01.007166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:01.350451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:01.371527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-75718ca9-d16d-462f-ab4e-3018375f4cd1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1279 microversion: 2.1 time: 0.530744 Jul 14 10:57:01.379481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 13/34] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:00 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1279 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:01.389734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:01.395518 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:01.403271 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:01.426759 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-25381a61-e3ab-4069-af71-13fb6ae697bf tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1273 microversion: 2.1 time: 0.443762 Jul 14 10:57:01.429400 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 22/35] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:00 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1273 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:01.430445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:01.431135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:01.432204 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:01.432857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:01.630104 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:01.631815 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:01.646566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:01.647637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:01.649243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:01.650561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:01.813066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:01.821477 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-04d8deeb-0a10-4aef-b3c4-995b30f4c8b6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1296 microversion: 2.1 time: 0.440363 Jul 14 10:57:01.831582 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 14/36] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:01 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1296 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:02.399343 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:02.400122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:02.411465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:02.412864 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:02.413613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:02.414445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:02.655031 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:02.684684 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:02.693311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:02.695671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f6014c69-b3cd-4083-9624-b88f57d2aefd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1351 microversion: 2.20 time: 1.070795 Jul 14 10:57:02.701152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 23/37] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:01 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1351 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:02.743187 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:02.746156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:02.775622 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:02.780098 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:02.788382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:02.793012 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:02.794434 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:02.804496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3f237ef9-923b-4d1a-a629-cb219fd1ee51 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1279 microversion: 2.1 time: 0.407689 Jul 14 10:57:02.809002 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 15/38] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:02 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1279 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:02.855044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:02.855777 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:02.871570 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:02.872050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:02.872832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:02.873338 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:04.464226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:04.484202 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-eddfb9b0-81fb-4ca9-b90e-e90611b014cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 1.638028 Jul 14 10:57:04.496848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 16/39] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:02 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:04.511238 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:04.511866 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:04.538904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:04.539283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:04.540135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:04.547005 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:05.370716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:05.409028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:05.412620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:05.413810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-dc223240-784d-4fdc-a1a5-a02f36a914be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1339 microversion: 2.20 time: 0.916124 Jul 14 10:57:05.414389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 17/40] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:04 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1339 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:05.434950 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:05.439332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:05.469766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:05.469766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:05.469766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:05.469766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:05.606324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:05.635826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f2e2ecd1-d41a-483f-967f-b528ef07c6f8 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 2.917727 Jul 14 10:57:05.636466 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 24/41] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:02 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 2935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:05.647652 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:05.649712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:05.668285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:05.669317 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:05.674202 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:05.676417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:06.077981 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:06.086288 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-30748fa6-8876-4e4f-bb65-561585b91ca8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.670513 Jul 14 10:57:06.086876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 18/42] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:05 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:06.225927 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:06.234719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2ce854c3-ea38-40ec-bbc8-f0e3d98bac80 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.596936 Jul 14 10:57:06.235991 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 25/43] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:05 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:06.435445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:06.436831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:06.459817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:06.460323 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:06.467449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:06.475044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:06.655683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:06.657177 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:06.668977 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:06.671615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:06.673935 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:06.675862 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:06.822285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:07.065568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:07.079275 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:07.092554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:07.097986 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-85cefb76-8bc5-41a6-b9a2-f21a01dd46c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1339 microversion: 2.20 time: 0.666960 Jul 14 10:57:07.100841 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 19/44] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:06 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1339 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:57:07.123038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:07.125214 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:07.156226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:07.156984 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:07.165513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:07.166169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:07.892762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:07.918393 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-551d40ff-6bcd-4f91-8cfb-5eb34e0fa700 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 1.268174 Jul 14 10:57:07.927920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 26/45] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:06 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:07.931738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:07.932318 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:07.942769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:07.946656 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:07.947765 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:07.948215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:08.015848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:08.033268 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5e9db822-69ef-42a1-b5d3-36df7b4fe748 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.921574 Jul 14 10:57:08.037345 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 20/46] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:07 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:08.122658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:08.123225 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:08.134449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:08.137557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:08.142984 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:08.144526 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:08.405229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=4 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:08.514625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=20 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:09.268955 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:09.289629 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:09.302095 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:09.305509 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bfb62d11-469a-4f7e-9201-dfdb14cde1cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1339 microversion: 2.20 time: 1.188057 Jul 14 10:57:09.316821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 21/47] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:08 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1339 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:57:09.489847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-5aba0d24-42b6-4421-be1a-2f830a4afc5f req-3643f5d1-3830-4220-9cce-6e554b906851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe7cf2e-7340-4d3a-8884-574984dcb2e6", "tag": "74ffb2a6-b0fd-4974-914f-63fb01cd1a8e"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:09.508918 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-5aba0d24-42b6-4421-be1a-2f830a4afc5f req-3643f5d1-3830-4220-9cce-6e554b906851 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.510578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-5aba0d24-42b6-4421-be1a-2f830a4afc5f req-3643f5d1-3830-4220-9cce-6e554b906851 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:09.544479 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-5aba0d24-42b6-4421-be1a-2f830a4afc5f req-3643f5d1-3830-4220-9cce-6e554b906851 service nova] Creating event network-changed:74ffb2a6-b0fd-4974-914f-63fb01cd1a8e for instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 on hv-cinder-84614 Jul 14 10:57:09.545616 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-5aba0d24-42b6-4421-be1a-2f830a4afc5f req-3643f5d1-3830-4220-9cce-6e554b906851 service nova] Acquired lock "compute-rpcapi-router" {{(pid=133221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 10:57:09.548649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.549730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:09.551542 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.553324 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:09.569083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.compute.rpcapi [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 10:57:09.572239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] Releasing lock "compute-rpcapi-router" {{(pid=133221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 10:57:09.614920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5bcbc4e0-4236-4d4f-8646-00dfa31f95e7 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293930 Jul 14 10:57:09.616356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:09.619671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 22/48] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:09.650477 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-964a6de5-96f0-4c1a-a782-66c7265e3cb6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 1.729178 Jul 14 10:57:09.651613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:09.652915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:09.658665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 27/49] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:07 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:09.673308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.675074 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:09.676066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:09.677462 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:09.678932 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.692687 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:09.725371 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.730493 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:09.737508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:09.737508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:10.581826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=28 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:10.803122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:10.846516 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-60313029-0444-4186-b3c0-1e6524b721b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 1.186333 Jul 14 10:57:10.855673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 28/50] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:09 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:10.937260 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:10.961667 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0de81ebf-ba3f-4294-870c-25e0c32e3166 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 1.333085 Jul 14 10:57:10.972116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 23/51] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:09 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:10.974292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:10.978210 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:10.993641 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:10.994092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:10.995104 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:10.995713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:11.089697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-5b499c2a-edaa-45bd-916f-2bf2fba378c9 req-da6d86b3-0936-4908-bb07-73df1e966610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866fb74a-bbb5-4346-9080-eb2a117ee2cf", "tag": "22421220-3077-41b7-8f35-d60e4cd33e0a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:11.126035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5b499c2a-edaa-45bd-916f-2bf2fba378c9 req-da6d86b3-0936-4908-bb07-73df1e966610 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:11.126875 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5b499c2a-edaa-45bd-916f-2bf2fba378c9 req-da6d86b3-0936-4908-bb07-73df1e966610 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:11.149869 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-5b499c2a-edaa-45bd-916f-2bf2fba378c9 req-da6d86b3-0936-4908-bb07-73df1e966610 service nova] Creating event network-changed:22421220-3077-41b7-8f35-d60e4cd33e0a for instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf on hv-cinder-84614 Jul 14 10:57:11.150763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5b499c2a-edaa-45bd-916f-2bf2fba378c9 req-da6d86b3-0936-4908-bb07-73df1e966610 service nova] Acquired lock "compute-rpcapi-router" {{(pid=133220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 10:57:11.152275 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:11.152949 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:11.153939 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:11.154568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:11.166231 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.compute.rpcapi [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 10:57:11.167370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] Releasing lock "compute-rpcapi-router" {{(pid=133220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 10:57:11.220959 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d51f58cd-1f64-49e4-980b-5b36916cbf86 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362198 Jul 14 10:57:11.223993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 29/52] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:11.239527 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:11.241285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:11.254273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:11.255287 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:11.257010 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:11.257987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:12.038438 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:12.049761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-68071057-9c2b-4e5a-ae04-173583346165 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.822870 Jul 14 10:57:12.061425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 30/53] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:11 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:12.073498 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:12.074193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:12.083686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:12.088737 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:12.099407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:12.100449 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:12.100912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:12.103970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:12.115365 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:12.141335 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:12.143097 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-08773478-88a7-4868-9d6b-2c5a9a9f3fa9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 1.179051 Jul 14 10:57:12.150280 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 24/54] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:10 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:12.156211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-d08427c4-825f-493b-aa59-8fe0dc5ffec5 req-e1273587-201a-449e-a510-7b7a47bef738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f20d4c-65f1-4c7c-b436-c1f4db0b527d", "tag": "4d1f30e4-cd27-4452-bd74-6ba39a7a6857"}, {"name": "network-changed", "server_uuid": "cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96", "tag": "ff4bff3c-060d-4301-8121-466dae5b3f56"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:12.184787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-d08427c4-825f-493b-aa59-8fe0dc5ffec5 req-e1273587-201a-449e-a510-7b7a47bef738 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:12.185365 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-d08427c4-825f-493b-aa59-8fe0dc5ffec5 req-e1273587-201a-449e-a510-7b7a47bef738 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:12.222140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-d08427c4-825f-493b-aa59-8fe0dc5ffec5 req-e1273587-201a-449e-a510-7b7a47bef738 service nova] Creating event network-changed:4d1f30e4-cd27-4452-bd74-6ba39a7a6857 for instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d on hv-cinder-84614 Jul 14 10:57:12.225513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-d08427c4-825f-493b-aa59-8fe0dc5ffec5 req-e1273587-201a-449e-a510-7b7a47bef738 service nova] Creating event network-changed:ff4bff3c-060d-4301-8121-466dae5b3f56 for instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 on hv-cinder-84614 Jul 14 10:57:12.248525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-d08427c4-825f-493b-aa59-8fe0dc5ffec5 req-e1273587-201a-449e-a510-7b7a47bef738 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094512 Jul 14 10:57:12.250624 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 25/55] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:12.260062 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:12.261743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:12.278671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:12.281321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:12.283210 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:12.284076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:12.920862 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:12.932675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9ab9f995-f91d-436d-9ce0-28117077d952 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.869627 Jul 14 10:57:12.933645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 31/56] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:12 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:13.005580 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:13.009545 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:13.016246 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-96f82375-8569-49ca-bbb7-cd8bc3d27496 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.763810 Jul 14 10:57:13.017326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 26/57] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:12 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:13.066643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:13.070402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:13.081760 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.082188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:13.087187 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.087966 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:13.169786 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:13.171327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:13.174006 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:13.193067 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.193734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:13.197330 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.197990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:13.386341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:13.388789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=87 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:13.399727 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-bf47739c-97fb-47f7-aa81-bc26ece73ec9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.336798 Jul 14 10:57:13.400410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 32/58] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:13 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:13.428180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:13.438494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:13.440517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:13.441861 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5a04ef26-0c65-4526-ae42-6507a1fd265a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.276221 Jul 14 10:57:13.443141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 27/59] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:13 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:13.658136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-d984e42c-da89-4fb5-a591-f0ec0aa95e4b req-7257f2fe-2199-41f7-a54d-3dcbcbac635c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:13.666359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-d984e42c-da89-4fb5-a591-f0ec0aa95e4b req-7257f2fe-2199-41f7-a54d-3dcbcbac635c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.666848 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-d984e42c-da89-4fb5-a591-f0ec0aa95e4b req-7257f2fe-2199-41f7-a54d-3dcbcbac635c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:13.681102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-d984e42c-da89-4fb5-a591-f0ec0aa95e4b req-7257f2fe-2199-41f7-a54d-3dcbcbac635c service nova] Creating event network-changed:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 10:57:13.683643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-d984e42c-da89-4fb5-a591-f0ec0aa95e4b req-7257f2fe-2199-41f7-a54d-3dcbcbac635c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029466 Jul 14 10:57:13.684224 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 33/60] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:13.949508 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:13.950120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:13.957700 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.958457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:13.959474 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:13.960189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.036761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:14.037458 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:14.050935 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:14.051379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.053880 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:14.054319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.148790 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:14.157313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ef4ad92c-df14-4757-abb1-65a7279f7055 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.211571 Jul 14 10:57:14.160461 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 28/61] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:13 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:14.289645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:14.298984 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8be17d1c-86cd-43ae-878b-998c74303a09 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.268714 Jul 14 10:57:14.299584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 34/62] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:14 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:14.416663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:14.417175 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:14.423650 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:14.424342 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.425317 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:14.426123 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.460814 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:14.461120 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:14.468439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:14.473262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.476223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:14.476651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:14.797940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:14.820793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:14.822313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:14.826960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:14.835230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-67656691-e3b0-462b-a40c-c3f47e27afa4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.422417 Jul 14 10:57:14.836851 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-18609ce4-2e56-43f8-bb2c-bc2eb7911a3f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.380385 Jul 14 10:57:14.837842 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 29/63] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:14 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:14.848470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 35/64] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:14 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:57:15.182085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:15.183014 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:15.191981 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.194483 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.197712 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.198936 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.316057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:15.316881 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:15.326548 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.327628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.327983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.334977 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.540747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:15.560091 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0f07c3fd-17bb-4e42-9d79-0e072bb1f6bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.385008 Jul 14 10:57:15.570468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 30/65] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:15 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:15.594102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:15.606178 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b9006de9-cfed-4390-b9f5-3051ae0f181b tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.294010 Jul 14 10:57:15.608188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 36/66] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:15 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:15.858801 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:15.859657 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:15.862321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:15.869328 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:15.878844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.880621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.881825 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.882430 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.883208 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.885161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:15.886820 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:15.888154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:16.099327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:16.106854 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1fceffad-bae2-4bf3-8da5-a078dfa2392d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.252990 Jul 14 10:57:16.107647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 31/67] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:15 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:16.132201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:16.143220 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:16.144744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:16.145845 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-34c46021-6a12-41f7-a747-3ed1bb36ec79 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.292601 Jul 14 10:57:16.146398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 37/68] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:15 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:16.577089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:16.577799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:16.584104 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:16.584557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:16.585338 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:16.585772 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:16.624552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:16.625823 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:16.633388 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:16.633912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:16.634836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:16.635302 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:16.772199 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:16.781770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4b5cceb3-4397-4d43-b407-852674248be2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.208486 Jul 14 10:57:16.782454 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 32/69] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:16 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:16.816106 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:16.823413 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b87fa6bb-24d9-4d93-a91b-4c33ec69d0b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.204788 Jul 14 10:57:16.824008 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 38/70] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:16 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:17.136602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:17.138569 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:17.155174 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.156312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.159669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.161633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.167388 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:17.168330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:17.186630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.192428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.193615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.194271 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.487405 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:17.494740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:17.494963 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b14644e7-b137-4c2b-a053-c8c1001adf26 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.374343 Jul 14 10:57:17.495539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 33/71] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:17 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:17.503920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:17.505455 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:17.506580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3c8e5be4-84eb-4001-a165-be7fe3f0f3ff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.345968 Jul 14 10:57:17.507137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 39/72] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:17 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:17.799462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:17.800130 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:17.806174 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.806624 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.807394 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.808072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.842227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:17.843470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:17.850212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.850957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:17.851745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:17.852215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:18.000051 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:18.009189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-59fb541b-7db2-486c-83eb-87d211691cd2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.214291 Jul 14 10:57:18.009690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 34/73] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:17 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:18.032994 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:18.041482 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8255d097-093b-4da8-ab18-4c0e3a112bc4 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.203555 Jul 14 10:57:18.042053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 40/74] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:17 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:18.511415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:18.512058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:18.518880 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:18.520613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:18.520613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:18.520775 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:18.526103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:18.526895 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:18.533403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:18.534182 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:18.535195 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:18.535830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:18.705426 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:18.714214 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3f92488c-2a8d-466e-9cd4-45baca977b64 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.206785 Jul 14 10:57:18.720054 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 35/75] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:18 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:18.730051 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:18.738607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:18.740156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:18.741295 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-953a4432-5dc8-4b3e-a208-16593fad203a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.219180 Jul 14 10:57:18.741891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 41/76] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:18 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:19.027656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:19.028289 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:19.034632 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.035058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.035830 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.036280 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.059020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:19.059623 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:19.066631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.067175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.068085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.068562 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.239518 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:19.247271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5f8bd07d-2451-4eb3-a330-ea75e4cb9c7d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.223503 Jul 14 10:57:19.247847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 36/77] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:19 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:19.248790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:19.257837 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b1ea0f8a-d3a4-442f-94ee-f38f6f7033a2 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.202533 Jul 14 10:57:19.258754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 42/78] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:19 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:19.730285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:19.735701 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:19.736349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:19.742620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.743082 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.743840 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.744290 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.759315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:19.759920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:19.766108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.766521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.767620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:19.768056 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:19.944449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:19.951277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:19.952320 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-fc6a32d5-6839-47a6-902d-1c8c162f61f6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.222947 Jul 14 10:57:19.953053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 37/79] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:19 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:19.959755 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:19.961444 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:19.962891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6dcda9d2-4144-447b-a182-7723ef7757be tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.207588 Jul 14 10:57:19.963438 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 43/80] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:19 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:20.267231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:20.267819 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:20.274186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:20.274638 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:20.275407 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:20.275842 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:20.276382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:20.277002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:20.283446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:20.283900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:20.284712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:20.285148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:20.489327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:20.503633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7cec0b76-c33f-421f-ba89-4af075c0c4ed tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.237955 Jul 14 10:57:20.507494 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:20.510000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 38/81] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:20 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:20.517130 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fc7a8f42-cf80-4f8d-a08c-46c0a5c34aa1 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.244194 Jul 14 10:57:20.518223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 44/82] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:20 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:20.971728 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:20.973120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:20.984649 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:20.985417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:20.997103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.000163 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.000364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.000969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.002310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.003154 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.003831 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.004369 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.163134 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:21.653273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:21.670982 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:21.672676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:21.673836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-77aced25-5e94-462d-bb1f-b7ad03c81979 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.695967 Jul 14 10:57:21.674414 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 45/83] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:20 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:57:21.692959 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:21.693506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:21.699710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.700204 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.700992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.701432 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.734704 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:21.742349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-03a4f795-dc48-446c-90d3-0f26454fd761 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.776976 Jul 14 10:57:21.752295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 39/84] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:20 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:21.758113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:21.759068 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:21.768363 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.768990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:21.769845 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:21.770519 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:22.089982 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:22.099525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a0797113-d82b-41f7-82f9-b1285f1e15ef tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.345823 Jul 14 10:57:22.101415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 40/85] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:21 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:22.108239 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:22.119556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-09894df4-8c05-4dd9-bab1-46a0153dc930 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.444069 Jul 14 10:57:22.129651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 46/86] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:21 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:22.691060 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:22.691797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:22.699419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:22.700077 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:22.701271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:22.701777 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:22.762333 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:22.763915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:22.799822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:22.801109 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:22.802684 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:22.803642 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:23.011417 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:23.027001 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:23.033276 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:23.036677 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d31f4550-1dc7-4963-9e1c-a155cdc7a091 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.349620 Jul 14 10:57:23.048433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 41/87] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:22 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:23.068924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:23.083899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-39a6a5ae-9338-4144-863c-9768bd5db86d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.327323 Jul 14 10:57:23.084710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 47/88] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:22 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:23.117314 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:23.118122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:23.131998 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:23.132466 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:23.133746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:23.134324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:23.135569 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-f07e5326-3f67-4809-9448-375caa6ae509 req-74e70e03-121b-42d6-ba06-ee4941e2e062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe7cf2e-7340-4d3a-8884-574984dcb2e6", "name": "network-vif-plugged", "status": "completed", "tag": "74ffb2a6-b0fd-4974-914f-63fb01cd1a8e"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:23.146687 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-f07e5326-3f67-4809-9448-375caa6ae509 req-74e70e03-121b-42d6-ba06-ee4941e2e062 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:23.147419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-f07e5326-3f67-4809-9448-375caa6ae509 req-74e70e03-121b-42d6-ba06-ee4941e2e062 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:23.162828 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-f07e5326-3f67-4809-9448-375caa6ae509 req-74e70e03-121b-42d6-ba06-ee4941e2e062 service nova] Creating event network-vif-plugged:74ffb2a6-b0fd-4974-914f-63fb01cd1a8e for instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 on hv-cinder-84614 Jul 14 10:57:23.169805 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-f07e5326-3f67-4809-9448-375caa6ae509 req-74e70e03-121b-42d6-ba06-ee4941e2e062 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119852 Jul 14 10:57:23.170918 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 42/89] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:23.177099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:23.178141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:23.185474 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:23.186793 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:23.187858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:23.188478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:23.456957 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:23.468455 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8b9ac594-b11c-4e7e-9d5b-c0d4b6e4a6e3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.295840 Jul 14 10:57:23.469302 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 43/90] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:23 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:23.484816 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:23.496351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-87af11b7-ab72-4b52-bd2c-f4fb0c1ed28c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.380978 Jul 14 10:57:23.497098 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 48/91] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:23 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:24.054793 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:24.055411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:24.062091 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.062347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.063076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.063517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.067651 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:24.101952 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:24.102572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:24.109336 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.109790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.110572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.111013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.244932 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:24.255885 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:24.257611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:24.258999 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7989c5ab-6229-43ac-92be-82b9ebb86229 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.208373 Jul 14 10:57:24.270871 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 44/92] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:24 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:24.285975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:24.293526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0667d357-b85c-4e66-9f39-ac332c77c647 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.195370 Jul 14 10:57:24.294085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 49/93] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:24 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:24.486333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:24.487415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:24.494141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.494595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.495379 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.495814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.514671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:24.515397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:24.528407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.530142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.532297 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:24.535609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:24.555499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=100 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:24.734305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:24.742578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2480212b-23ed-420c-90c6-03eb175c12f1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.260748 Jul 14 10:57:24.766691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 45/94] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:24 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:24.792571 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:24.805770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-967f2676-e3f8-40b0-a514-72b1b6e8814a tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.296151 Jul 14 10:57:24.816033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 50/95] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:24 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:25.198847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866fb74a-bbb5-4346-9080-eb2a117ee2cf", "name": "network-vif-plugged", "status": "completed", "tag": "22421220-3077-41b7-8f35-d60e4cd33e0a"}, {"server_uuid": "43f20d4c-65f1-4c7c-b436-c1f4db0b527d", "name": "network-vif-plugged", "status": "completed", "tag": "4d1f30e4-cd27-4452-bd74-6ba39a7a6857"}, {"server_uuid": "cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96", "name": "network-vif-plugged", "status": "completed", "tag": "ff4bff3c-060d-4301-8121-466dae5b3f56"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:25.214666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.215618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.239812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] Creating event network-vif-plugged:22421220-3077-41b7-8f35-d60e4cd33e0a for instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf on hv-cinder-84614 Jul 14 10:57:25.240419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] Creating event network-vif-plugged:4d1f30e4-cd27-4452-bd74-6ba39a7a6857 for instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d on hv-cinder-84614 Jul 14 10:57:25.241310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] Creating event network-vif-plugged:ff4bff3c-060d-4301-8121-466dae5b3f56 for instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 on hv-cinder-84614 Jul 14 10:57:25.253998 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-7affed63-85de-4e82-b5e8-80b738a13a18 req-0c0a0eaf-fc70-4164-aef5-5d66031a14fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.060078 Jul 14 10:57:25.255444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 46/96] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:25.288019 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:25.289523 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:25.302038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.302733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.304919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.305673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.312083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:25.312937 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:25.330682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.339208 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.341985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.344851 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.651494 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:25.652602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:25.662096 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:25.664400 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:25.664866 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ffb91884-a273-4bac-90d1-b0d5ec4c9775 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.357648 Jul 14 10:57:25.667918 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 47/97] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:25 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:25.668040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5d5c69e1-b497-40bb-9ac5-0a46ee3ebec3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.391264 Jul 14 10:57:25.673243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 51/98] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:25 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:25.772546 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:25.773385 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:25.780764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.781294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.782121 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.782774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.823555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:25.824196 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:25.830971 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.832029 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:25.841805 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:25.843018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:26.025523 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:26.047553 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c8e391b1-67b4-4ebc-ad5a-07780e61d61c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.279372 Jul 14 10:57:26.055660 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:26.056893 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:25 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:26.068926 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b634ba75-81db-41ba-b1d1-a4ae48d09d37 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1315 microversion: 2.1 time: 0.249750 Jul 14 10:57:26.070505 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 52/100] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:25 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:26.681653 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:26.682402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:26.683764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:26.684623 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:26.689428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:26.689896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:26.690769 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:26.691204 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:26.692896 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:26.693501 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:26.694319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:26.694761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:26.888435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:26.895453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:26.896753 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f6a2a36e-ecb1-4872-a6e0-ec5561c963fd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.218840 Jul 14 10:57:26.904106 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 49/101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:26 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:26.905638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:26.907333 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:26.908641 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1afda595-11ff-4e7e-bd3b-aeb8b4027d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.229189 Jul 14 10:57:26.909216 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 53/102] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:26 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:27.073522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:27.074436 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:27.081066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.081737 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.082862 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.083513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.087477 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:27.088116 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:27.094743 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.095523 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.096741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.097351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.289135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:27.296228 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:27.304614 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-689b9455-ad7e-4c9b-b022-02392f19da28 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.234694 Jul 14 10:57:27.305253 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-957f0321-c0c3-4549-95e8-8c2a94f55086 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1503 microversion: 2.1 time: 0.221710 Jul 14 10:57:27.305382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 50/103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:27 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:27.306076 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 54/104] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:27 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:27.310077 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-181f1c98-2556-4566-84e6-19e4afd86fa2 req-62907956-8d45-45f2-88f9-322c9752105d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "name": "network-vif-plugged", "status": "completed", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:27.321286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-181f1c98-2556-4566-84e6-19e4afd86fa2 req-62907956-8d45-45f2-88f9-322c9752105d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.321737 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-181f1c98-2556-4566-84e6-19e4afd86fa2 req-62907956-8d45-45f2-88f9-322c9752105d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.335000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-181f1c98-2556-4566-84e6-19e4afd86fa2 req-62907956-8d45-45f2-88f9-322c9752105d service nova] Creating event network-vif-plugged:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 10:57:27.340332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-181f1c98-2556-4566-84e6-19e4afd86fa2 req-62907956-8d45-45f2-88f9-322c9752105d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Jul 14 10:57:27.341131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 51/105] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:27.918020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:27.918020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:27.923220 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.923671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.924600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.925032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.928207 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:27.928895 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:27.936074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.937394 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:27.938333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:27.938944 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:28.264540 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:28.272497 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a37440e2-d2bc-4b47-9f98-d369af0babd8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.361538 Jul 14 10:57:28.273067 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 55/106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:27 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:28.275410 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:28.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:28.285926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:28.287032 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bbf89cea-3d98-41fa-a24e-76dace763d5c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.363446 Jul 14 10:57:28.287616 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 52/107] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:27 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:28.322306 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:28.322937 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:28.329544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:28.330141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:28.330988 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:28.331496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:28.464213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:28.481442 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6543f1dd-54a8-40a6-8693-6807c5537f2e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.156310 Jul 14 10:57:28.482521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 56/108] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:28 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:29.289600 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:29.290240 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:29.298743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:29.299478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:29.300426 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:29.300876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:29.306152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:29.306856 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:29.313582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:29.314029 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:29.314788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:29.315214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:29.502995 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:29.505508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:29.514912 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-20d6b712-60e7-4b94-b37c-e9457ca508c9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.228846 Jul 14 10:57:29.517479 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:29.518913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:29.520066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-043b8671-76a5-47cc-ab77-0c2a04a7a405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.217960 Jul 14 10:57:29.520610 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 57/109] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:29 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:57:29.525211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 53/110] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:29 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:29.531744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:29.532395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:29.538405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:29.538849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:29.539613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:29.540073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:29.715626 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:29.725007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cd06bb7c-1185-4555-ae99-c79682560b2f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1321 microversion: 2.1 time: 0.199253 Jul 14 10:57:29.736407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 58/111] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:29 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:30.532960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:30.534202 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:30.538078 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:30.539214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:30.540825 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.541271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.542040 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.542496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.546092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.546587 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.547395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.547802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.761035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:30.762808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:30.770953 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-35cbafb8-93cd-47d4-a1b3-f7235091dad7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1363 microversion: 2.1 time: 0.242499 Jul 14 10:57:30.771351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:30.779023 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:30.780287 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-42dfca64-4aa2-40c9-ba2a-a1d7ce11fa14 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.246205 Jul 14 10:57:30.781945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 54/112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:30 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:30.785018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 59/113] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:30 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:30.800958 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:30.801770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:30.809687 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.810424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.812169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.812853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.858171 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63e85370-6c09-4cb0-8af6-37fe1650b681"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:30.860346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:30.867948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.869753 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:30.870787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:30.871730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:31.125457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:31.137677 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0aabd3b1-f91e-4530-8565-b6483097309a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1515 microversion: 2.1 time: 0.343374 Jul 14 10:57:31.138764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 55/114] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:30 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:31.157626 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:31.158625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:31.164789 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:31.165304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:31.166127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:31.167007 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:31.250721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lazy-loading 'flavor' on Instance uuid cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:57:31.380827 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0a3c6d80-ba39-4f1f-a215-826f11e0bf6b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96/action" status: 200 len: 32 microversion: 2.1 time: 0.227335 Jul 14 10:57:31.386096 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 56/115] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 10:57:31 2022] POST /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:57:31.391907 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:31.393080 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:31.409621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:31.410284 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:31.411132 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:31.411576 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:31.645241 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:31.658945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-da47ce34-cd8e-4372-b845-7fb3c48019c3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.271226 Jul 14 10:57:31.664288 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 57/116] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:31 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:31.789149 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:31.789773 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:31.799659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:31.804243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:31.805298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:31.805954 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.122191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:32.133405 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-08f6e3f1-e881-4d35-a425-d3bcac779caf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1548 microversion: 2.1 time: 0.348890 Jul 14 10:57:32.134434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 58/117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:31 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1548 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:32.139088 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:32.139677 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:32.146887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:32.147326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.148273 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:32.148705 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.310641 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:32.326976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:32.328613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:32.329707 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6e08da5f-70b0-42aa-9205-d8fde3e39cb4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.194236 Jul 14 10:57:32.330388 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 59/118] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:32 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:32.334961 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:32.335742 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:32.347164 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:32.347864 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.349611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:32.350256 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.355831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:32.535762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d6282970-2c69-416c-90b8-b2e3004763e3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204304 Jul 14 10:57:32.536859 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 60/119] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 10:57:32 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:32.651961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ec96c99f-ebfb-4f4b-a0a8-6f02cdb4028c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "POST /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.798386 Jul 14 10:57:32.653849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 60/120] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 10:57:30 2022] POST /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6/os-volume_attachments => generated 194 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:32.680590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:32.681335 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:32.694208 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:32.694876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.696231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:32.697030 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:32.897676 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:32.909847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-23498fba-4cea-46e3-a145-9126863dd4f9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.232917 Jul 14 10:57:32.910586 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 61/121] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:32 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:33.350237 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:33.353150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:33.374719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:33.375203 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:33.376008 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:33.377228 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:33.650875 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:33.660755 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:33.662344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:33.663616 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-aebf2427-e0d3-4413-8307-890e7a3861ac tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1406 microversion: 2.20 time: 0.318925 Jul 14 10:57:33.664541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 61/122] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:33 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:57:33.930506 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:33.931539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:33.939583 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:33.940055 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:33.940830 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:33.941264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:34.280334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:34.295726 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-befa250d-b32d-47ff-89ab-fe45d56bc150 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.370818 Jul 14 10:57:34.296585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 62/123] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:33 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:34.615480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-e26ee2a3-c7a4-420a-be4a-ee8a6118e2b1 req-f0700112-dc57-40db-bfda-edbe734dd2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f20d4c-65f1-4c7c-b436-c1f4db0b527d", "tag": "4d1f30e4-cd27-4452-bd74-6ba39a7a6857"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:34.639236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-e26ee2a3-c7a4-420a-be4a-ee8a6118e2b1 req-f0700112-dc57-40db-bfda-edbe734dd2c7 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:34.639665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-e26ee2a3-c7a4-420a-be4a-ee8a6118e2b1 req-f0700112-dc57-40db-bfda-edbe734dd2c7 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:34.665991 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-e26ee2a3-c7a4-420a-be4a-ee8a6118e2b1 req-f0700112-dc57-40db-bfda-edbe734dd2c7 service nova] Creating event network-changed:4d1f30e4-cd27-4452-bd74-6ba39a7a6857 for instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d on hv-cinder-84614 Jul 14 10:57:34.672861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-e26ee2a3-c7a4-420a-be4a-ee8a6118e2b1 req-f0700112-dc57-40db-bfda-edbe734dd2c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061506 Jul 14 10:57:34.676979 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 62/124] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:34.682393 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:34.683237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:34.692780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:34.693437 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:34.694489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:34.695468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:35.085053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:35.099301 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:35.102629 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:35.106033 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e6d08f9d-7609-4545-ae5a-85e7deda06ef tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1599 microversion: 2.20 time: 0.427816 Jul 14 10:57:35.106624 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 63/125] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:57:34 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1599 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:57:35.126720 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:35.127301 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:35.139320 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:35.141580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:35.142887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:35.143332 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:35.311838 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d9861ad5-8646-4ec5-accf-0d26afc4012d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.189902 Jul 14 10:57:35.313564 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 63/126] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jul 14 10:57:35 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:57:35.321539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:35.322425 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:35.335855 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:35.336891 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:35.339551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:35.340179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:36.167315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:36.175522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6c5c5c5c-9360-4e17-861f-8b2200f558ad tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.866910 Jul 14 10:57:36.176138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 64/127] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:35 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:37.193685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:37.194322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:37.201043 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:37.201483 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:37.202844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:37.203281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:38.032794 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:38.045468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2e1c054b-f872-492f-ac9a-32ac10ea366a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.855793 Jul 14 10:57:38.046041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 64/128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:37 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:38.881765 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-61af4948-92af-4d02-9744-d33600dab432 req-087e5755-f352-4540-a517-e52c633b26a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:38.895891 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-61af4948-92af-4d02-9744-d33600dab432 req-087e5755-f352-4540-a517-e52c633b26a8 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:38.896390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-61af4948-92af-4d02-9744-d33600dab432 req-087e5755-f352-4540-a517-e52c633b26a8 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:38.909117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-61af4948-92af-4d02-9744-d33600dab432 req-087e5755-f352-4540-a517-e52c633b26a8 service nova] Creating event network-changed:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 10:57:38.920305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-61af4948-92af-4d02-9744-d33600dab432 req-087e5755-f352-4540-a517-e52c633b26a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042002 Jul 14 10:57:38.921293 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 65/129] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:39.063503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:39.064449 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:39.077904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:39.078290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:39.079063 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:39.079827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:39.413480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:39.427723 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3df4698b-0abf-430b-8fae-142bf963da8c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.364620 Jul 14 10:57:39.428669 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 65/130] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:39 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:40.453177 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:40.454632 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:40.464325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:40.465014 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:40.466032 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:40.467027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:40.684972 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:40.696594 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a4ff44f6-14b3-453e-97c0-b1b15c9417a7 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.253796 Jul 14 10:57:40.697439 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 66/131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:40 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:41.714606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:41.715194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:41.728748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:41.729780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:41.731708 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:41.732963 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:41.779603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:41.993344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:42.002717 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d73c0f54-2ea4-4f30-870a-862cbc00c9b0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.292438 Jul 14 10:57:42.003640 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 66/132] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:41 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:42.756591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:42.757420 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:42.767133 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:42.768099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:42.769299 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:42.770060 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:42.802312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:57:42.901133 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-26b80cf6-8b1b-4a76-819a-c6c473db91ce tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 204 len: 0 microversion: 2.1 time: 0.148983 Jul 14 10:57:42.901902 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 67/133] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 10:57:42 2022] DELETE /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:57:42.910354 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:42.911518 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:42.914100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=71 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:42.920552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:42.921133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:42.921924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:42.922359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:43.021682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:43.022195 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:43.029175 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:43.029797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:43.030918 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:43.031626 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:43.086804 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:43.095173 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d935c4a1-070b-47fc-8d23-706bd4cb7c1c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1555 microversion: 2.1 time: 0.188851 Jul 14 10:57:43.106283 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 67/134] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:42 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:43.180895 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:43.191451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e0695520-9213-40fa-b8f1-80e38cb2f998 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.174490 Jul 14 10:57:43.192057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 68/135] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:43 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:44.112915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:44.113545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:44.120799 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:44.121539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:44.122318 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:44.122756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:44.209145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:44.209799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:44.211783 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:44.217975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:44.218726 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:44.219518 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:44.219982 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:44.333310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:44.344175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-316d496e-a33b-4159-8f75-e566bd81c2a0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1555 microversion: 2.1 time: 0.235014 Jul 14 10:57:44.346331 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 68/136] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:44 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:44.403414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:44.412877 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d05afe31-3c3e-4dd5-8b9e-f62dd368cb8f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.207736 Jul 14 10:57:44.413820 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 69/137] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:44 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:45.362043 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:45.362934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:45.372231 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:45.373049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:45.374033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:45.374567 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:45.436660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:45.441632 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:45.455630 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:45.456286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:45.458163 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:45.459183 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:45.565618 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:45.589552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c541955e-c91f-4fa5-b3c8-90ed3497e0c3 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1555 microversion: 2.1 time: 0.226083 Jul 14 10:57:45.590364 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 69/138] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:45 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:45.639638 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:45.651844 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-41e1d0d3-cfd1-4901-87d3-af71112a0224 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.224985 Jul 14 10:57:45.652450 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 70/139] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:45 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:46.607759 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:46.608393 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:46.614996 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:46.615439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:46.616198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:46.616949 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:46.669478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:46.670074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:46.676282 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:46.676736 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:46.677522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:46.677946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:46.871432 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:46.883016 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a32a7041-907f-45eb-b5bc-44f4a6737357 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1555 microversion: 2.1 time: 0.278950 Jul 14 10:57:46.884010 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 70/140] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:46 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:46.903949 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:46.922334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a646d495-cb38-466d-9722-acab2a16bf5d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.252326 Jul 14 10:57:46.924068 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 71/141] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:46 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:47.857628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-180ed166-cbac-4f7b-8628-9880513e20b6 req-52503b7a-1b5e-43ef-a4bb-f74f63206166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe7cf2e-7340-4d3a-8884-574984dcb2e6", "name": "network-vif-deleted", "tag": "74ffb2a6-b0fd-4974-914f-63fb01cd1a8e"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:57:47.867822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-180ed166-cbac-4f7b-8628-9880513e20b6 req-52503b7a-1b5e-43ef-a4bb-f74f63206166 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:47.868287 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-180ed166-cbac-4f7b-8628-9880513e20b6 req-52503b7a-1b5e-43ef-a4bb-f74f63206166 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:47.879575 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-180ed166-cbac-4f7b-8628-9880513e20b6 req-52503b7a-1b5e-43ef-a4bb-f74f63206166 service nova] Creating event network-vif-deleted:74ffb2a6-b0fd-4974-914f-63fb01cd1a8e for instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 on hv-cinder-84614 Jul 14 10:57:47.884560 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-180ed166-cbac-4f7b-8628-9880513e20b6 req-52503b7a-1b5e-43ef-a4bb-f74f63206166 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030575 Jul 14 10:57:47.885140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 71/142] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:57:47.904277 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:47.905023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:47.911026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:47.911471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:47.912321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:47.912781 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:47.941007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:47.941711 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:47.948620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:47.949094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:47.950331 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:47.950766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:47.987206 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:47.997327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3e01a939-f33f-4be3-8f10-461d6d65bb8d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1513 microversion: 2.1 time: 0.096529 Jul 14 10:57:47.998695 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:47 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1513 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:48.103013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:48.111091 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b0a9c80a-1536-4305-8ea9-573584c010d5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.174566 Jul 14 10:57:48.111738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 72/144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:47 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:49.015784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:49.016456 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:49.023112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:49.024122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:49.024909 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:49.025351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:49.094655 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:49.103509 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-25cbd4d0-5b97-49cf-97b3-e92a3ade4fb0 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1346 microversion: 2.1 time: 0.092210 Jul 14 10:57:49.104321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 73/145] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:49 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:49.129655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:49.130285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:49.136471 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:49.136998 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:49.137864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:49.138414 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:49.305269 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:49.313108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ff579eec-b477-4e7c-a853-9da7d7936c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.189096 Jul 14 10:57:49.313683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 73/146] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:49 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:50.120452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:50.121205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:50.127471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:50.127952 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:50.128721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:50.129158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:50.194747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:50.203294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-89ea6e5d-b0c3-428a-af6c-f053ee1c6d3d tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1346 microversion: 2.1 time: 0.086620 Jul 14 10:57:50.203864 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 74/147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:50 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:50.331230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:50.331956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:50.338900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:50.339334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:50.340125 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:50.340554 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:50.484972 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:50.492723 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e08fcf2d-19a4-48ce-8fac-b0294efebefc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.166573 Jul 14 10:57:50.493307 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:50 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:51.222671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:51.223315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:51.234574 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:51.250996 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:51.257117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:51.260026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:51.331633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:51.333218 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:51.333852 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lazy-loading 'fault' on Instance uuid afe7cf2e-7340-4d3a-8884-574984dcb2e6 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:57:51.412030 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc60574eb7f4df6b193c244973ed8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd3b32ea75463c95bb2d451c59cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:51.415815 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:51.430081 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4ae48901-613a-4f2b-8bbc-07c9cb05a223 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 200 len: 1351 microversion: 2.1 time: 0.213111 Jul 14 10:57:51.441733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 75/149] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:51 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:51.510339 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:51.511733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:51.519096 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:51.519543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:51.520345 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:51.520776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:51.665191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:51.676831 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a20ef909-bc82-47fb-b214-f26b782ac0bf tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.169939 Jul 14 10:57:51.677598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:51 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:52.448644 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:52.449822 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:52.458023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:52.458023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:52.458495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:52.458932 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:52.478805 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] HTTP exception thrown: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Request method failure captured: Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 HTTP/1.1 Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqdZOmJAO8EKbKeLLiluIKi2JJIdaZ7nD40-CLnoz-Nnfq_0gFvlcS1wFqc7M1PDwn4iUI9kw6WiR3vC4Rq__mUDlGYkYi1mZ0KQJDS_O_P7ewC5w-yjalqMo8zsac-5SLaESXJwkRvksi-9On66864gsrJAyll7eGJFuaprCEPjg Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 10:57:52.483898 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 5cc60574eb7f4df6b193c244973ed8c3 Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.485138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'afe7cf2e-7340-4d3a-8884-574984dcb2e6'} Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:57:52.485812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.486904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.489076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Returning 404 to user: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:57:52.489076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-88a77aa8-6c92-4ea4-9575-2aa90bec35b7 tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 404 len: 111 microversion: 2.1 time: 0.040590 Jul 14 10:57:52.489434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 76/151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:52 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:57:52.693544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:52.694766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:52.702110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:52.702712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:52.703489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:52.703958 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:52.749832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:52.751325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:52.758561 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:52.759045 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:52.759980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:52.760579 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:52.776433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] HTTP exception thrown: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Request method failure captured: Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6/os-volume_attachments HTTP/1.1 Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqdZOmJAO8EKbKeLLiluIKi2JJIdaZ7nD40-CLnoz-Nnfq_0gFvlcS1wFqc7M1PDwn4iUI9kw6WiR3vC4Rq__mUDlGYkYi1mZ0KQJDS_O_P7ewC5w-yjalqMo8zsac-5SLaESXJwkRvksi-9On66864gsrJAyll7eGJFuaprCEPjg Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 10:57:52.779478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 5cc60574eb7f4df6b193c244973ed8c3 Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.781101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'server_id': 'afe7cf2e-7340-4d3a-8884-574984dcb2e6'} Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:57:52.781745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:52.786599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:52.787713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Returning 404 to user: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:57:52.787713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e75599ed-bc45-4124-9b96-8bf5697dfebe tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037311 Jul 14 10:57:52.787713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 77/152] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 10:57:52 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:57:52.878615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:52.887537 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f6547ec8-0997-408a-8e8f-5b0269c58cc0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.197655 Jul 14 10:57:52.888178 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 76/153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:52 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:53.906230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:53.906824 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:53.913451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:53.913908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:53.914717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:53.915138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:54.075315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:54.083933 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-dcef747c-19d0-4786-9994-49601c0e2f79 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.181906 Jul 14 10:57:54.086009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 78/154] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:53 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:54.222470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:54.223330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:54.229728 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:54.230179 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:54.230985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:54.231421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:54.245608 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] HTTP exception thrown: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Request method failure captured: Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 HTTP/1.1 Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZqdZOmJAO8EKbKeLLiluIKi2JJIdaZ7nD40-CLnoz-Nnfq_0gFvlcS1wFqc7M1PDwn4iUI9kw6WiR3vC4Rq__mUDlGYkYi1mZ0KQJDS_O_P7ewC5w-yjalqMo8zsac-5SLaESXJwkRvksi-9On66864gsrJAyll7eGJFuaprCEPjg Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:57:54.250046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 5cc60574eb7f4df6b193c244973ed8c3 Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.251374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'afe7cf2e-7340-4d3a-8884-574984dcb2e6'} Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:57:54.252145 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.253180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.254811 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Returning 404 to user: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:57:54.255368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8c8693d1-019c-49b7-9d89-8d7ad7ac84ac tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 404 len: 111 microversion: 2.1 time: 0.037527 Jul 14 10:57:54.256553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 77/155] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 10:57:54 2022] DELETE /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:57:54.264336 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:54.265539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] [instance: afe7cf2e-7340-4d3a-8884-574984dcb2e6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:54.272292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:54.272779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:54.273603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:54.274047 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:54.288913 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] HTTP exception thrown: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Request method failure captured: Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 HTTP/1.1 Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqdZOmJAO8EKbKeLLiluIKi2JJIdaZ7nD40-CLnoz-Nnfq_0gFvlcS1wFqc7M1PDwn4iUI9kw6WiR3vC4Rq__mUDlGYkYi1mZ0KQJDS_O_P7ewC5w-yjalqMo8zsac-5SLaESXJwkRvksi-9On66864gsrJAyll7eGJFuaprCEPjg Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 10:57:54.290659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dcd3b32ea75463c95bb2d451c59cdd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 5dcd3b32ea75463c95bb2d451c59cdd1 Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-DeleteServersTestJSON-453879127 Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 5cc60574eb7f4df6b193c244973ed8c3 Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-DeleteServersTestJSON-453879127-project Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.291846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'afe7cf2e-7340-4d3a-8884-574984dcb2e6'} Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:57:54.292919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. Jul 14 10:57:54.294496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:57:54.295452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] Returning 404 to user: Instance afe7cf2e-7340-4d3a-8884-574984dcb2e6 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:57:54.295452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-96bef794-51a2-4104-886f-a8c54516cc5c tempest-DeleteServersTestJSON-453879127 tempest-DeleteServersTestJSON-453879127-project] 10.222.0.27 "GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6" status: 404 len: 111 microversion: 2.1 time: 0.031695 Jul 14 10:57:54.295452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 79/156] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:54 2022] GET /compute/v2.1/servers/afe7cf2e-7340-4d3a-8884-574984dcb2e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:57:55.105450 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:55.106620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:55.116789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:55.117331 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:55.118181 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:55.118665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:55.446378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:55.480081 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-146bf3d2-b731-4964-a1ac-fa23b4a701fc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.378315 Jul 14 10:57:55.480830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 78/157] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:55 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:56.498510 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:56.500209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:56.520578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:56.521528 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:56.525201 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:56.525968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:56.763691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:56.777027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2d7fa502-ded0-47e4-b36d-6740ea1377db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.283154 Jul 14 10:57:56.778221 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 80/158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:56 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:57:57.794985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:57.796237 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:57.805845 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:57.806519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:57.807636 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:57.808105 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:58.048866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:58.068254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f0702a83-ebb9-473c-8fdd-67cf06ab00be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.276437 Jul 14 10:57:58.069152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 79/159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:57 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:57:59.087073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:57:59.087762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:57:59.094236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:59.094760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:59.095778 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:57:59.096384 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:57:59.494745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:57:59.508359 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d3f0c8ae-327c-4e31-88d7-f2734a3b0255 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.425820 Jul 14 10:57:59.510153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 81/160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:57:59 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:00.526803 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:00.527414 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:00.534239 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:00.534663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:00.535431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:00.535839 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:00.672616 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:00.680303 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-93412fd1-c4d5-433b-88ff-9e418c1cd557 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.157345 Jul 14 10:58:00.680881 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 80/161] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:00 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:01.697933 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:01.698572 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:01.706006 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:01.706458 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:01.707224 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:01.707656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:01.867242 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:01.877877 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e70e038f-2353-4168-8834-22535cbf5163 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.183703 Jul 14 10:58:01.878372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 82/162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:01 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:02.895668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:02.896265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:02.902576 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:02.903028 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:02.903846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:02.904321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:03.042973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:03.051858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-49240391-f2bc-4372-a483-62e8af033898 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.160860 Jul 14 10:58:03.052456 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 81/163] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:02 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:04.071521 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:04.072141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:04.078884 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:04.079341 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:04.080139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:04.080568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:04.252270 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:04.261808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5c5f7508-5df5-4b68-b9f1-ad6228264073 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.193050 Jul 14 10:58:04.262526 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 83/164] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:04 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:05.291180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:05.291942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:05.299638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:05.300121 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:05.301066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:05.301482 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:05.473712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:05.490768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f1b5d86f-e741-4840-ac59-4f411944c2be tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.198378 Jul 14 10:58:05.491403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 82/165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:05 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:06.507162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:06.507881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:06.514660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:06.515224 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:06.516188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:06.516533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:06.664609 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:06.672524 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6a3cc43d-c386-4f12-984a-684f27b434c4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.169131 Jul 14 10:58:06.673161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 84/166] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:06 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:07.694238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:07.695094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:07.704908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:07.705358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:07.706124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:07.706546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:07.848281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:07.859602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-aad9fae8-5faf-4d5d-b4ad-7551a1078fbc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.172033 Jul 14 10:58:07.860181 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 83/167] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:07 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:08.881712 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:08.882340 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:08.888859 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:08.889584 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:08.890603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:08.891035 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:09.050938 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:09.059865 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-18a96c77-1ad6-4978-8198-721a643beaa9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.182194 Jul 14 10:58:09.060485 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 85/168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:08 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:10.081374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:10.081981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:10.088651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:10.089018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:10.090008 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:10.090447 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:10.106446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=100 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:10.240032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:10.248327 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-05174563-029b-4674-a856-30a4e2ab34cc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.170817 Jul 14 10:58:10.249072 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 84/169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:10 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:11.266292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:11.267161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:11.273791 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:11.274236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:11.275191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:11.275625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:11.425980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:11.433600 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f5db1388-a28f-4c2d-b85d-7050c70e4cd0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.171890 Jul 14 10:58:11.434169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 86/170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:11 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:12.451134 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:12.451720 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:12.459839 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:12.460446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:12.461227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:12.461659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:12.662377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:12.686118 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-876b5f9a-cdec-45fe-8b8a-f6f0a8465c09 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.239104 Jul 14 10:58:12.686756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 85/171] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:12 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:13.703847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:13.704578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:13.710989 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:13.711515 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:13.712323 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:13.712761 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:13.855793 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:13.864033 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-79e98bb6-d5fc-475d-985b-cece44655585 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1521 microversion: 2.1 time: 0.164414 Jul 14 10:58:13.864637 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 87/172] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:13 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:14.889683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:14.891223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:14.897747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=38 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:14.899712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:14.900502 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:14.901302 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:14.902045 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.076729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:15.086408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-106ab707-adf7-47c3-93a4-f4d71f940a98 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1501 microversion: 2.1 time: 0.200562 Jul 14 10:58:15.086987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 86/173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:14 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:15.102709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:15.103325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:15.105234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=40 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:15.114914 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:15.115392 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.116295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:15.116831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:15.260620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:15.270733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5ea468f1-ac92-422a-b3bd-bd46842bb835 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1516 microversion: 2.1 time: 0.171857 Jul 14 10:58:15.271322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 88/174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:15 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:16.664309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:16.665264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:16.674201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:16.674876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:16.675656 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:16.676503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:16.700045 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lazy-loading 'flavor' on Instance uuid 866fb74a-bbb5-4346-9080-eb2a117ee2cf {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:58:16.820915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-90b33221-4384-4194-8af3-13b9fb0b085a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/action" status: 200 len: 32 microversion: 2.1 time: 0.160626 Jul 14 10:58:16.821560 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 87/175] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 10:58:16 2022] POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:58:16.830716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:16.831373 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:16.837800 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:16.838286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:16.839306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:16.839896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:17.073372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:17.082119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-78d80798-9ad5-4762-84e8-42fe76ad11d9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.255354 Jul 14 10:58:17.082689 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 89/176] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:16 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:18.100214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:18.101159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:18.109235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:18.110037 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:18.110915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:18.111412 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:18.262073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:18.270342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6d958f22-f2be-45a4-ae87-e7d2a3a582c9 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.174658 Jul 14 10:58:18.280161 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 88/177] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:18 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:19.290809 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:19.291719 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:19.301880 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:19.302861 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:19.304261 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:19.305014 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:19.446152 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:19.453882 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a61be5bf-8671-4c3e-9855-fdda593d193d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.169756 Jul 14 10:58:19.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 90/178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:19 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:19.804603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-559094422", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "networks": [{"uuid": "d4487426-2c0a-4c52-a920-124b04373819"}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:19.854659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] validate_networks() for [('d4487426-2c0a-4c52-a920-124b04373819', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:58:20.250335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:58:20.251094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:58:20.251214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:58:20.251638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:58:20.252065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:58:20.263677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:20.264253 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:20.265182 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:20.265613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:20.283742 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Getting quotas for project 8a913265f84c43579ce0fb5a2604b663. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:58:20.288482 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Getting quotas for user a7d7f7af47db49d9a30db75c76980cb9 and project 8a913265f84c43579ce0fb5a2604b663. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:58:20.299798 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:58:20.302134 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:58:20.355672 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-385646b6-fe0b-4059-9e11-d312979902d5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554783 Jul 14 10:58:20.356600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 89/179] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:58:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:58:20.372670 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-74873941-22b2-4f50-b7da-3bf2a9dc5cc4 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:20.374064 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-74873941-22b2-4f50-b7da-3bf2a9dc5cc4 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:20.432778 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-74873941-22b2-4f50-b7da-3bf2a9dc5cc4 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:20.441169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-74873941-22b2-4f50-b7da-3bf2a9dc5cc4 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1213 microversion: 2.1 time: 0.077842 Jul 14 10:58:20.442179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 91/180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:20 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:20.471661 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:20.472699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:20.479784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:20.480378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:20.481186 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:20.481723 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:20.624793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:20.636162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fd6d168a-bb8d-49be-a390-ceaff21de3bc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.168688 Jul 14 10:58:20.637086 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:20 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:21.459188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:21.459797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:21.466921 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:21.467458 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:21.468301 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:21.468900 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:21.564639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:21.572746 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6aab40fe-2321-412d-b370-75f3eba5c33f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1283 microversion: 2.1 time: 0.117574 Jul 14 10:58:21.573690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 92/182] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:21 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:21.654509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:21.655218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:21.662382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:21.663148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:21.664095 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:21.664530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:21.901292 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:21.910037 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-76edbdc3-1ca3-4579-9567-436446144b62 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.259655 Jul 14 10:58:21.910603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 91/183] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:21 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:22.121685 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:22.122211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:22.129013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:22.129469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:22.130230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:22.130681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:22.155119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9e55a0a3-f268-447d-83f0-c6a85f8a6d1e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/ips" status: 200 len: 145 microversion: 2.1 time: 0.037309 Jul 14 10:58:22.155801 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 93/184] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 10:58:22 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:22.417333 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-353254764", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:22.467762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] validate_networks() for None {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:58:22.590495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:22.591067 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:22.598070 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:22.599103 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:22.599270 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:22.599735 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:22.603084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=89 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:22.963995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:58:22.964465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:58:22.964856 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:58:22.965810 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:58:22.966521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:58:22.974528 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:22.978312 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:22.978928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:22.979910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:22.980480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:22.986089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-86d06dcc-aa91-479f-8ffd-fefe13a85486 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.399438 Jul 14 10:58:22.987327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 94/185] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:22 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:22.993448 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:22.994395 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:23.001691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:23.001974 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:23.002747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:23.003489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:23.009018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Getting quotas for project fef76eedbb014e64a2a61df170001185. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:58:23.012975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Getting quotas for user f56ddee9ed6b403f947205b533a89a5a and project fef76eedbb014e64a2a61df170001185. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:58:23.025570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:58:23.028198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:58:23.078489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3e5274d1-b04a-45e8-ba9e-cef7a4c227ee tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664927 Jul 14 10:58:23.079065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 92/186] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:58:23.089766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c987ff6f-6e55-4f28-928d-920af52fc252 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:23.090382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c987ff6f-6e55-4f28-928d-920af52fc252 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:23.466159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c987ff6f-6e55-4f28-928d-920af52fc252 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:23.474922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c987ff6f-6e55-4f28-928d-920af52fc252 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1214 microversion: 2.1 time: 0.389696 Jul 14 10:58:23.476120 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 93/187] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:23 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1214 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:23.542493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:23.554649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-35982f82-6786-42b9-be32-a41bad32b365 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.565683 Jul 14 10:58:23.556076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 95/188] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:22 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:23.631273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-9f054ffc-e142-4225-a9d7-bcfbaa2e09f6 req-63f854b0-045c-4ec8-9fe0-a7debfd284f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96924b9c-14ce-4058-9f22-f38ce60bdaba", "tag": "f9a7f576-03d4-41d1-b13d-d87c5b28a3a0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:23.641141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-9f054ffc-e142-4225-a9d7-bcfbaa2e09f6 req-63f854b0-045c-4ec8-9fe0-a7debfd284f5 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:23.641915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-9f054ffc-e142-4225-a9d7-bcfbaa2e09f6 req-63f854b0-045c-4ec8-9fe0-a7debfd284f5 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:23.674706 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-9f054ffc-e142-4225-a9d7-bcfbaa2e09f6 req-63f854b0-045c-4ec8-9fe0-a7debfd284f5 service nova] Creating event network-changed:f9a7f576-03d4-41d1-b13d-d87c5b28a3a0 for instance 96924b9c-14ce-4058-9f22-f38ce60bdaba on hv-cinder-84614 Jul 14 10:58:23.680246 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-9f054ffc-e142-4225-a9d7-bcfbaa2e09f6 req-63f854b0-045c-4ec8-9fe0-a7debfd284f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052387 Jul 14 10:58:23.682466 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 94/189] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:24.002640 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:24.003254 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:24.010653 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:24.011331 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:24.012268 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:24.012703 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:24.208239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:24.222038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0bbff286-70bd-49cc-a6a7-c98946e2e9fa tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.223054 Jul 14 10:58:24.223020 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 96/190] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:23 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:24.493045 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:24.493661 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:24.501139 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:24.501501 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:24.502439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:24.502873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:24.572570 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:24.573184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:24.588299 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:24.588904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:24.590030 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:24.590721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:24.601879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:24.622149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-08abc2eb-8414-44a5-9920-cc226634faf1 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1272 microversion: 2.1 time: 0.129705 Jul 14 10:58:24.624099 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 95/191] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:24 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:24.825760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:24.836165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-182e05a7-03fd-4ebe-8acc-381ad101aeeb tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.267253 Jul 14 10:58:24.846481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 97/192] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:24 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:25.238471 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:25.239059 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:25.246023 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:25.246400 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:25.247200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:25.247629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:25.457403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:25.465899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8b35be39-2341-4139-887d-920c6c3a75cd tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.231526 Jul 14 10:58:25.466650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 96/193] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:25 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:25.641305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:25.641914 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:25.649005 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:25.649541 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:25.650409 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:25.650969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:25.785261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d71669b-bd32-4187-866f-3bef1fe9f335"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:25.791213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:25.797812 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:25.798113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:25.798869 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:25.799313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:26.014385 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:26.023979 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6273c758-b358-41b4-bb15-374364924a3a tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.386631 Jul 14 10:58:26.025399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 98/194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:25 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:26.038827 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:26.039525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:26.056167 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:26.056923 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:26.058086 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:26.058751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:26.106683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5057905e-8f23-4d61-a5ad-7634fc1f090f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324839 Jul 14 10:58:26.119796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 97/195] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 10:58:25 2022] POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:26.416822 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:26.432606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-eb55c2ab-524e-4bed-b39c-88725b6dfc8b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.405047 Jul 14 10:58:26.433216 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 99/196] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:26 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:26.484381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:26.485213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:26.492265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:26.492776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:26.493535 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:26.494110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:26.723177 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:26.730829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0e0b995d-22b2-4888-a49a-d58ad6e348a1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.251820 Jul 14 10:58:26.731605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 98/197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:26 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:26.814520 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-b9680f9c-e718-49d9-95b4-a35ca67c7283 req-68db06c2-caea-4b89-acf6-527029c245bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bda806c-5ade-47ab-bea9-1ba0fe721724", "tag": "de22b20b-6545-4810-8b8d-b2131962405d"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:26.823703 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-b9680f9c-e718-49d9-95b4-a35ca67c7283 req-68db06c2-caea-4b89-acf6-527029c245bd service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:26.824159 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-b9680f9c-e718-49d9-95b4-a35ca67c7283 req-68db06c2-caea-4b89-acf6-527029c245bd service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:26.841707 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-b9680f9c-e718-49d9-95b4-a35ca67c7283 req-68db06c2-caea-4b89-acf6-527029c245bd service nova] Creating event network-changed:de22b20b-6545-4810-8b8d-b2131962405d for instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 on hv-cinder-84614 Jul 14 10:58:26.847926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-b9680f9c-e718-49d9-95b4-a35ca67c7283 req-68db06c2-caea-4b89-acf6-527029c245bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037600 Jul 14 10:58:26.848752 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 100/198] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:27.042287 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:27.042978 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:27.051441 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:27.052451 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:27.053602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:27.054034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:27.451063 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:27.451744 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:27.471705 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:27.472181 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:27.472970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:27.473408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:27.598596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:27.612314 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7e7a66ce-a982-432f-93dc-011955390fe7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.573060 Jul 14 10:58:27.614600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 99/199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:27 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:27.695945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:27.705609 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-61fdd469-18c6-4681-b430-7a09cc2ca242 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.259173 Jul 14 10:58:27.706388 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 101/200] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:27 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:27.747975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:27.748743 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:27.754987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:27.755431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:27.756213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:27.756642 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:27.896227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:27.899362 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:27.908905 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6b6ebb6e-572f-4555-b51e-d79eb329c417 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.165110 Jul 14 10:58:27.909694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 100/201] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:27 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:28.631084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:28.631743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:28.639486 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:28.639984 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:28.640952 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:28.641841 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:28.724546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:28.725206 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:28.732581 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:28.733244 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:28.734615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:28.735634 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:28.893812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:28.902494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-249b109a-9af2-4595-af39-8973ba5084e7 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.275707 Jul 14 10:58:28.903266 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 102/202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:28 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:28.928556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:28.929267 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:28.935554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:28.936222 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:28.937809 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:28.938425 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:29.012256 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:29.021054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-aad5edb1-e1c8-42d3-ab30-4695f41a07d3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.302208 Jul 14 10:58:29.021726 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 101/203] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:28 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:29.169216 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:29.178272 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3c460da1-7881-4cb7-b34d-68d2482ccd60 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.253778 Jul 14 10:58:29.179185 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 103/204] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:28 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:29.623186 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-63b5dbd3-2450-4d2a-ad3b-1e5aec54f196 req-b6ae42a7-d773-4435-920b-7bc1e2d47825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96924b9c-14ce-4058-9f22-f38ce60bdaba", "name": "network-vif-plugged", "status": "completed", "tag": "f9a7f576-03d4-41d1-b13d-d87c5b28a3a0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:29.634818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-63b5dbd3-2450-4d2a-ad3b-1e5aec54f196 req-b6ae42a7-d773-4435-920b-7bc1e2d47825 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:29.635648 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-63b5dbd3-2450-4d2a-ad3b-1e5aec54f196 req-b6ae42a7-d773-4435-920b-7bc1e2d47825 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:29.650309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-63b5dbd3-2450-4d2a-ad3b-1e5aec54f196 req-b6ae42a7-d773-4435-920b-7bc1e2d47825 service nova] Creating event network-vif-plugged:f9a7f576-03d4-41d1-b13d-d87c5b28a3a0 for instance 96924b9c-14ce-4058-9f22-f38ce60bdaba on hv-cinder-84614 Jul 14 10:58:29.655392 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-63b5dbd3-2450-4d2a-ad3b-1e5aec54f196 req-b6ae42a7-d773-4435-920b-7bc1e2d47825 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036281 Jul 14 10:58:29.656291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 102/205] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:29.918586 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:29.919286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:29.927747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:29.928286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:29.929087 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:29.929543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:30.040675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:30.041552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:30.048541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:30.048988 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:30.049866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:30.050273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:30.074177 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:30.081851 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-97a46ec2-3d23-45ec-8de1-4424323b1af0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.167220 Jul 14 10:58:30.082407 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 104/206] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:29 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:30.188504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:30.194407 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:30.195046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:30.196688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-965b388a-ad9b-40bd-92b4-96b6b28394f8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.161395 Jul 14 10:58:30.197327 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 103/207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:30 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:30.201151 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:30.201768 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:30.202682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:30.203326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:30.337024 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:30.345138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-23700151-b2eb-428c-b757-a6eee4eb656f tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.154534 Jul 14 10:58:30.345714 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 105/208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:30 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:31.099105 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:31.099726 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:31.107408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:31.107913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:31.108694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:31.109128 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:31.214464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:31.215390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:31.218204 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:31.225646 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:31.226195 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:31.227220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:31.227865 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:31.258919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:31.270207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d019da4d-f309-4b6c-980a-53841b8cc34e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.174892 Jul 14 10:58:31.270816 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 104/209] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:31 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:31.362375 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:31.363030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:31.368997 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:31.369439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:31.370189 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:31.370611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:31.374397 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:31.382661 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-62245ea2-1c0f-4637-95e3-f9986ea8eb18 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.172191 Jul 14 10:58:31.383322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 106/210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:31 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:31.520367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:31.529556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-91ac1abc-7738-4c9f-9459-c5e8226fa315 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1313 microversion: 2.1 time: 0.170548 Jul 14 10:58:31.530402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 105/211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:31 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:32.287424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:32.287980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:32.294492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.294939 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.295723 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.296197 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.400642 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:32.401546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:32.409162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.409366 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.410122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.410553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.463000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:32.475080 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0d07f310-677a-472a-9c6d-01587a28429e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.191352 Jul 14 10:58:32.478234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 107/212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:32 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:32.546572 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:32.547234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:32.553331 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.553775 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.554539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.554977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.558043 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:32.567578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-18bdb28b-5f5b-4231-8ef7-0f39f98f995a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.170850 Jul 14 10:58:32.568510 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 106/213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:32 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:32.663066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:32.663993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:32.672762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.673300 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.674127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:32.674617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:32.709902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-00106095-81d3-4de0-bd2c-a2f669b62ba3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/ips" status: 200 len: 153 microversion: 2.20 time: 0.053330 Jul 14 10:58:32.711006 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 107/214] 10.222.0.27 () {60 vars in 1288 bytes} [Thu Jul 14 10:58:32 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/ips => generated 153 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:58:32.720824 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:32.728495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a68e295e-e4ae-4405-98c2-b71f6a8369e5 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1497 microversion: 2.1 time: 0.185799 Jul 14 10:58:32.729578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 108/215] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:32 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:33.265729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:33.266233 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:33.268322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:33.274222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.274657 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.275410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.275835 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.302151 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:58:33.387749 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-799ae561-62d4-400c-b10b-f5312a93bd05 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 204 len: 0 microversion: 2.1 time: 0.125793 Jul 14 10:58:33.388544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 108/216] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 10:58:33 2022] DELETE /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:58:33.397122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:33.397872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:33.404165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.405148 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.405560 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.405992 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.496456 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:33.497151 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:33.499497 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=14 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:33.506458 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.506897 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.507673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.508301 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.567269 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:33.585162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-952fe9ae-db8d-4737-a971-0dd9bf5a1824 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1503 microversion: 2.1 time: 0.190828 Jul 14 10:58:33.587132 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 109/217] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:33 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:33.607906 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:33.609009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:33.615973 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.616639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.617557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.618138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.824432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:33.828332 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:33.834886 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7cde4a3f-28ff-4b83-837c-7ccf6b9b949a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.246531 Jul 14 10:58:33.835590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 110/218] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:33 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:33.841764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fecab55a-6ba2-47d4-876d-0aafcda0069d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:33.843853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ff5eff08-d94b-43c5-be78-fb0f6940788e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.352540 Jul 14 10:58:33.844459 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 109/219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:33 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:33.857273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-b21180db-9703-4333-9297-ddf7ec0a8524 req-130ea34b-a9a9-41cf-b973-473c619c243f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda806c-5ade-47ab-bea9-1ba0fe721724", "name": "network-vif-plugged", "status": "completed", "tag": "de22b20b-6545-4810-8b8d-b2131962405d"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:33.858765 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fecab55a-6ba2-47d4-876d-0aafcda0069d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.859237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fecab55a-6ba2-47d4-876d-0aafcda0069d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.866436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-b21180db-9703-4333-9297-ddf7ec0a8524 req-130ea34b-a9a9-41cf-b973-473c619c243f service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.867073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-b21180db-9703-4333-9297-ddf7ec0a8524 req-130ea34b-a9a9-41cf-b973-473c619c243f service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.878357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-b21180db-9703-4333-9297-ddf7ec0a8524 req-130ea34b-a9a9-41cf-b973-473c619c243f service nova] Creating event network-vif-plugged:de22b20b-6545-4810-8b8d-b2131962405d for instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 on hv-cinder-84614 Jul 14 10:58:33.883907 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-b21180db-9703-4333-9297-ddf7ec0a8524 req-130ea34b-a9a9-41cf-b973-473c619c243f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038133 Jul 14 10:58:33.884707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 110/220] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:33.919595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:33.926734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-fecab55a-6ba2-47d4-876d-0aafcda0069d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Going to try to stop instance {{(pid=133221) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 10:58:33.970034 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-fecab55a-6ba2-47d4-876d-0aafcda0069d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action" status: 202 len: 0 microversion: 2.1 time: 0.132843 Jul 14 10:58:33.970647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 111/221] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 10:58:33 2022] POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:58:33.979375 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:33.980270 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:33.987020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.987317 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:33.988111 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:33.988542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.168235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:34.176506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0841433b-29de-4b8d-ab66-465bd16f3004 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.201170 Jul 14 10:58:34.177080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 111/222] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:33 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:34.605574 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:34.606558 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:34.606671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:34.607221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:34.613321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.614127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.615042 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.615261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.615417 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.615712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.616588 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.617018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.640080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lazy-loading 'flavor' on Instance uuid 049f0944-f485-4674-9518-e2b0c244c2c6 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:58:34.760571 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:34.770794 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a9f83928-285d-41a5-9add-bc4e35d774c1 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1503 microversion: 2.1 time: 0.171905 Jul 14 10:58:34.771716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 112/223] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:34 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:34.852372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:34.852982 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:34.859050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.859568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.860542 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.860978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.951543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-78ed5201-6d22-4bda-9e12-905b790257ce tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/action" status: 202 len: 0 microversion: 2.20 time: 0.348943 Jul 14 10:58:34.952227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 112/224] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 10:58:34 2022] POST /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:58:34.959378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:34.960210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:34.967216 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.967656 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:34.968617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:34.969099 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:35.012135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:35.020396 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-14027135-2752-4528-a99e-c34303942aa2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.171663 Jul 14 10:58:35.029990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 113/225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:34 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:35.035262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:35.035926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:35.042708 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:35.043411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:35.044326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:35.044872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:35.124763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:35.133440 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e85e837f-d88b-472b-ad1e-a8425031069e tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.179506 Jul 14 10:58:35.134054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 113/226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:34 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:35.194050 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:35.194673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:35.201259 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:35.201802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:35.202639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:35.203166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:35.369043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:35.384770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:35.386554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:35.387858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8d997eb4-0774-4c78-bfb2-4b7792d3b571 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.356619 Jul 14 10:58:35.390557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 114/227] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:35 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:35.552113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:35.560291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-78be474b-819f-4531-85bf-2d3a93414414 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.369900 Jul 14 10:58:35.561092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 114/228] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:35 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:35.788374 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:35.789795 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:35.797011 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:35.797777 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:35.798660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:35.799199 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.024721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.037686 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-19177e70-3453-4a58-a9d3-61baff5fb0da tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1503 microversion: 2.1 time: 0.253288 Jul 14 10:58:36.038262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:36.039123 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:36.039477 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 115/229] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:35 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:36.052054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.052775 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.053696 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.054310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.074974 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:36.154206 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:36.155179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:36.166122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.167307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.168387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.169349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.342763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.351606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-16ab4ef7-6f04-4de5-8d75-1b609e86ab0f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.318339 Jul 14 10:58:36.352809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 115/230] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:36 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:36.393151 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-741cd8f9-200d-40b5-b88e-17e8bb29ba3a req-a0761111-a5a8-479e-9653-69e6fe4bc453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96924b9c-14ce-4058-9f22-f38ce60bdaba", "name": "network-vif-deleted", "tag": "f9a7f576-03d4-41d1-b13d-d87c5b28a3a0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:36.406948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-741cd8f9-200d-40b5-b88e-17e8bb29ba3a req-a0761111-a5a8-479e-9653-69e6fe4bc453 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.407788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-741cd8f9-200d-40b5-b88e-17e8bb29ba3a req-a0761111-a5a8-479e-9653-69e6fe4bc453 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.420655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-741cd8f9-200d-40b5-b88e-17e8bb29ba3a req-a0761111-a5a8-479e-9653-69e6fe4bc453 service nova] Creating event network-vif-deleted:f9a7f576-03d4-41d1-b13d-d87c5b28a3a0 for instance 96924b9c-14ce-4058-9f22-f38ce60bdaba on hv-cinder-84614 Jul 14 10:58:36.426989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-741cd8f9-200d-40b5-b88e-17e8bb29ba3a req-a0761111-a5a8-479e-9653-69e6fe4bc453 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037925 Jul 14 10:58:36.428068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 116/231] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:58:36.435011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:36.435725 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:36.444200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.445121 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.446181 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.446627 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.454299 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.462536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0204c9cf-c301-450f-8231-6ca3b98ab3a0 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.314539 Jul 14 10:58:36.463250 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 116/232] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:36 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:36.579295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:36.580125 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:36.587559 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.588173 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.589082 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:36.589620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:36.603405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.615245 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.617827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.619218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d6e0668e-e7bf-49b7-9733-1b0b35746c80 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.189296 Jul 14 10:58:36.631061 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 117/233] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:36 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:36.749207 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:36.763192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a179eba6-249f-44de-a402-e40848f7edb1 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.188578 Jul 14 10:58:36.763912 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 117/234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:36 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:37.055627 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:37.056909 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.063142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:37.065193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.065846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.066627 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.067055 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.142741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:37.151110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-456aed4e-d24d-4498-8d2d-7e056875d46e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1298 microversion: 2.1 time: 0.100247 Jul 14 10:58:37.151775 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 118/235] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:37 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:37.369517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:37.370248 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.377333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.377778 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.378539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.378971 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.478660 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:37.479371 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.491396 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.491847 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.492662 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.493103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.540089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:37.548840 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8fc1b4a8-b53b-4ad5-8be2-25a70a1aea26 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1502 microversion: 2.1 time: 0.183504 Jul 14 10:58:37.549411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 118/236] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:37 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:37.567013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ec95500-41ca-4b4e-8779-3ebb4cd38159"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:37.568175 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.574546 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.574994 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.575764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.576275 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.601785 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] HTTP exception thrown: Cannot 'attach_volume' instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf while it is in vm_state rescued Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Request method failure captured: Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/os-volume_attachments HTTP/1.1 Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 74 Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZxCzm8p1YviuXJJgYmxPWWWm8xd2NLzFeQZiWjRg4vQN9lBIVLZer67nLhgb3z8M7YSkQ8X0n-Ewm-xM3Lnef0BuA3f6tRGIHdG63v99lMYJ4ep8nb3Fax4qpuhOeyavefDN426pqfnUz6zlZBeQEP6XzBuqDXubUb36fMllsRdHw Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: c2d5301114244be2a74210484c6536ef Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 10:58:37.603494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2d5301114244be2a74210484c6536ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2d5301114244be2a74210484c6536ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: c2d5301114244be2a74210484c6536ef Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: b47991b6880c4a91ab42d2567eee61aa Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {"volumeAttachment": {"volumeId": "7ec95500-41ca-4b4e-8779-3ebb4cd38159"}} Jul 14 10:58:37.605025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Cannot 'attach_volume' instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf while it is in vm_state rescued Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'server_id': '866fb74a-bbb5-4346-9080-eb2a117ee2cf', 'body': {'volumeAttachment': {'volumeId': '7ec95500-41ca-4b4e-8779-3ebb4cd38159'}}} Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:58:37.606140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf while it is in vm_state rescued Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:58:37.607492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:58:37.609770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:58:37.609770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:58:37.609770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf while it is in vm_state rescued Jul 14 10:58:37.609770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 10:58:37.611405 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Returning 409 to user: Cannot 'attach_volume' instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf while it is in vm_state rescued {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:58:37.612979 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-aa317fb0-8c28-4a96-9d6b-63dad861136a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049915 Jul 14 10:58:37.618210 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 119/237] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 10:58:37 2022] POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 10:58:37.623495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:37.624434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.631577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.634276 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.636086 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.636694 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.684016 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:37.693202 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-bde678de-6fcb-4a90-8f37-dea2b9280da8 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1314 microversion: 2.1 time: 0.218364 Jul 14 10:58:37.693961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 119/238] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:37 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:37.704529 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:37.704529 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.709998 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.711722 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.714336 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.714859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.735319 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-73a62aec-b9ae-4b3a-b141-656b1299d459 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/action" status: 202 len: 0 microversion: 2.1 time: 0.115577 Jul 14 10:58:37.736295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 120/239] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 10:58:37 2022] POST /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:58:37.750205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:37.751055 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:37.761554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.762004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:37.763386 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:37.764061 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.032383 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:38.034633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:38.042956 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-129196b0-3a04-43df-8b38-e6cecbb33f17 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1510 microversion: 2.1 time: 0.301195 Jul 14 10:58:38.043862 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 121/240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:37 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:38.048962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:38.049579 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:38.056146 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.056366 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:38.056821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.057370 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.057806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.057932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:38.059094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-093d37ef-b111-4ebd-81da-c38468cf4405 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.363234 Jul 14 10:58:38.059655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 120/241] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:37 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:38.167406 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:38.169462 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:38.178381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.179023 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.180190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.181430 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.226680 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.227484 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.228152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lazy-loading 'fault' on Instance uuid 96924b9c-14ce-4058-9f22-f38ce60bdaba {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:58:38.231501 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:38.242084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5aec71f5-04af-4e92-8007-03fc0effd0d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.197090 Jul 14 10:58:38.250965 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 122/242] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:38 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:38.307799 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:38.317528 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-832a9b13-3930-4f46-b762-31b95f2d0728 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 200 len: 1303 microversion: 2.1 time: 0.153980 Jul 14 10:58:38.318131 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 121/243] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:38 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:38.712835 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:38.713631 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:38.722769 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.723673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:38.725160 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:38.726562 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.023229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:39.035340 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2cb48939-37c8-4178-9622-340785a70d9f tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1464 microversion: 2.1 time: 0.326950 Jul 14 10:58:39.035979 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 123/244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:38 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:39.060276 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:39.061032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:39.072978 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.073809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.074847 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.077983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.080435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:39.081248 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:39.090555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.092683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.093664 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.099453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.451041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:39.451257 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:39.460743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:39.462083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:39.463283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-239c3f53-df9b-4712-b069-e341c9f0e16c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.387795 Jul 14 10:58:39.468844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c8e70d11-298a-458d-9fc6-3efa6c336f0d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1510 microversion: 2.1 time: 0.412507 Jul 14 10:58:39.472321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 122/245] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:39 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:39.482299 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:39.482982 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:39.487089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 124/246] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:39 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:39.493105 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:39.493725 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:39.497590 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.498300 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.500122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.500822 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.501783 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.501922 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.502232 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.503980 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.546358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:58:39.664835 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f0ad9ab3-a92d-41ee-81d2-be67ababe626 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 204 len: 0 microversion: 2.1 time: 0.190944 Jul 14 10:58:39.665457 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 123/247] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 10:58:39 2022] DELETE /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:58:39.681410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:39.682378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: 96924b9c-14ce-4058-9f22-f38ce60bdaba] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:39.690964 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.691616 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.692595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.693190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.721645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] HTTP exception thrown: Instance 96924b9c-14ce-4058-9f22-f38ce60bdaba could not be found. Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Request method failure captured: Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba HTTP/1.1 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_bK9MAxHn6QpmfHGkrmwwkF89atEku0w_8gFKWyqpD47iPwChkvjSIoZf8l4p7-e4fCZ_zzFZfqI2C671_T3g570bjxmhCtLiS9RqBM9_RHFYk5hXyD08z1QrsMXvriSQncykpCG2wxTzhuh5lelvKqVmlZpgHpk4qwmK5CzACcP20 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 8a913265f84c43579ce0fb5a2604b663 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesActionsTest-583233254 Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:58:39.723776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesActionsTest-583233254 Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 8a913265f84c43579ce0fb5a2604b663 Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesActionsTest-583233254 Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesActionsTest-583233254-project Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a7d7f7af47db49d9a30db75c76980cb9 Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesActionsTest-583233254-project Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 96924b9c-14ce-4058-9f22-f38ce60bdaba could not be found. Jul 14 10:58:39.725249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '96924b9c-14ce-4058-9f22-f38ce60bdaba'} Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96924b9c-14ce-4058-9f22-f38ce60bdaba could not be found. Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:58:39.726085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96924b9c-14ce-4058-9f22-f38ce60bdaba could not be found. Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96924b9c-14ce-4058-9f22-f38ce60bdaba could not be found. Jul 14 10:58:39.727395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:39.728644 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:39.729761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Returning 404 to user: Instance 96924b9c-14ce-4058-9f22-f38ce60bdaba could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:58:39.730763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-43f17177-e37e-4441-ac35-9e776a620085 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba" status: 404 len: 111 microversion: 2.1 time: 0.053968 Jul 14 10:58:39.731470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 124/248] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:39 2022] GET /compute/v2.1/servers/96924b9c-14ce-4058-9f22-f38ce60bdaba => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:58:39.747206 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:39.748481 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:39.749094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-72cff461-6026-47a6-ab01-6ca3a453b396 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.262451 Jul 14 10:58:39.749990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 125/249] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:39 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:39.773408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.773979 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.776071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:39.776580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:39.869026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1593677551", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "networks": [{"uuid": "d4487426-2c0a-4c52-a920-124b04373819"}]}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:39.933733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] validate_networks() for [('d4487426-2c0a-4c52-a920-124b04373819', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:58:40.064448 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:40.075691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-526a5f02-f7a6-444b-9cf8-ed5db8dd93c6 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1470 microversion: 2.1 time: 0.342287 Jul 14 10:58:40.086921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 125/250] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:39 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:40.384829 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:58:40.385256 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:58:40.385728 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:58:40.386306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:58:40.386649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:58:40.396900 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.397405 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.398328 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.398766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.417512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Getting quotas for project 8a913265f84c43579ce0fb5a2604b663. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:58:40.421753 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Getting quotas for user a7d7f7af47db49d9a30db75c76980cb9 and project 8a913265f84c43579ce0fb5a2604b663. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:58:40.433577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:58:40.435969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:58:40.487848 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:40.488658 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:40.495911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d673d637-62ae-4784-b2c2-204a4d7cd2b8 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633527 Jul 14 10:58:40.498116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 126/251] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:58:40.499347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.501137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.502085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.503149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.506349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:40.511708 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:40.520797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.521244 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.522158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.522589 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.525725 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:40.748799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:40.766099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:40.770845 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:40.792866 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-23651a33-60e5-4389-bc90-8fca032122a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.290562 Jul 14 10:58:40.807465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 127/252] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:40 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:40.820960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-65693e0c-a481-452b-9777-a2b57e6c5678 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:40.821642 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-65693e0c-a481-452b-9777-a2b57e6c5678 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:40.822768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:40.832873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4f56c8d3-6f51-4f15-b578-7c08dbde2b43 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1510 microversion: 2.1 time: 0.349386 Jul 14 10:58:40.833926 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 126/253] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:40 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:40.848887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:40.849565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:40.886109 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.886931 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.889786 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:40.890436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:40.915836 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-65693e0c-a481-452b-9777-a2b57e6c5678 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:40.929717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-65693e0c-a481-452b-9777-a2b57e6c5678 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1214 microversion: 2.1 time: 0.120155 Jul 14 10:58:40.931006 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 128/254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:40 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:41.077304 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:41.093805 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:41.094464 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c5d736e4-af1f-4045-9861-b3a1e7ea6263 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.258787 Jul 14 10:58:41.095289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 127/255] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:40 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:41.095432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:41.097693 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:41.104129 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:41.104516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:41.105301 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:41.105744 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:41.590340 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:41.599117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-82c88d0a-ab8a-4a91-b467-204a2df7199c tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1470 microversion: 2.1 time: 0.509240 Jul 14 10:58:41.609312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 129/256] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:41 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:41.814453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:41.815352 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:41.822377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:41.822938 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:41.823939 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:41.824584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:41.852951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:41.853394 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:41.862474 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:41.863237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:41.864075 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:41.864549 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.261560 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:42.264808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:42.274250 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:42.274691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a6255b7d-e2ae-4ccb-9d03-13b12a98c484 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1510 microversion: 2.1 time: 0.427712 Jul 14 10:58:42.276264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 130/257] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:41 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:42.276925 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:42.278290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ccda5c52-5572-4bd4-b695-5a8f014b2bdf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.468247 Jul 14 10:58:42.278841 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 128/258] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:41 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:42.287761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:42.290315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:42.294129 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:42.294750 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:42.298207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:42.298635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.299417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:42.299846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.302443 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:42.303054 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.304013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:42.304628 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.538375 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:42.557033 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-90c8246f-97ac-40df-8a15-e2e0ab5a06cb tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1210 microversion: 2.1 time: 0.276382 Jul 14 10:58:42.557938 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 131/259] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:42 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1210 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:42.617191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:42.617737 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:42.629253 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:42.629705 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.630487 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:42.631536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:42.675604 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:42.692718 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4bb16d8a-3c79-419c-ad1c-449b52793f59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.412685 Jul 14 10:58:42.693316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 129/260] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:42 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:43.134807 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ddee9ed6b403f947205b533a89a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef76eedbb014e64a2a61df170001185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:43.159108 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ddc7efdb-d530-4a33-8616-35c29576bb09 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 200 len: 1470 microversion: 2.1 time: 0.541405 Jul 14 10:58:43.160343 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 132/261] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:42 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 1470 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:43.292685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:43.298192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:43.299215 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:43.303343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:43.311088 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:43.314306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:43.315536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:43.317116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:43.328654 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:43.334916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:43.335916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:43.339615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.328297 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:44.339079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-bfb54062-2dea-4b60-ba7c-75181a3677df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1516 microversion: 2.1 time: 1.050935 Jul 14 10:58:44.351257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 130/262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:43 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1516 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:44.359380 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:44.360659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:44.371754 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:44.386646 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.386874 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:44.389122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.389496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:44.390986 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.391102 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0beee91b-fec8-4051-8b2b-cfec250a47fd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 1.097404 Jul 14 10:58:44.391626 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 133/263] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:43 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:58:44.403346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.409591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:44.410444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:44.418849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:44.432306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.432966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.433923 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.435826 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.695650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:44.726639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e782ca93-31c5-46c9-ad02-83c80af69441 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1272 microversion: 2.1 time: 0.384006 Jul 14 10:58:44.729027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 131/264] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:44 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:44.748631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-6d042ebc-f621-45b6-96ba-e055b38fcfd0 req-983abc9e-d0d9-4443-be2f-1cbdb4f9b741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda806c-5ade-47ab-bea9-1ba0fe721724", "name": "network-vif-deleted", "tag": "de22b20b-6545-4810-8b8d-b2131962405d"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:44.776390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-6d042ebc-f621-45b6-96ba-e055b38fcfd0 req-983abc9e-d0d9-4443-be2f-1cbdb4f9b741 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.777678 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-6d042ebc-f621-45b6-96ba-e055b38fcfd0 req-983abc9e-d0d9-4443-be2f-1cbdb4f9b741 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.814840 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-6d042ebc-f621-45b6-96ba-e055b38fcfd0 req-983abc9e-d0d9-4443-be2f-1cbdb4f9b741 service nova] Creating event network-vif-deleted:de22b20b-6545-4810-8b8d-b2131962405d for instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 on hv-cinder-84614 Jul 14 10:58:44.826377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-6d042ebc-f621-45b6-96ba-e055b38fcfd0 req-983abc9e-d0d9-4443-be2f-1cbdb4f9b741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095823 Jul 14 10:58:44.829513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 132/265] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:44.837165 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:44.845005 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] [instance: 5bda806c-5ade-47ab-bea9-1ba0fe721724] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:44.865069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.865513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.866315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:44.866743 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:44.934182 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] HTTP exception thrown: Instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 could not be found. Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Request method failure captured: Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 HTTP/1.1 Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_bMKe0h-yOBcfHKga9MHiBuGDGyTjmFEJFPBzLoza-64imqDbe10_A2JYMq3IsmZHnVkyRzJ_Fr1o23wWJZ4je16Bch3sgsvSLlXgpPyi5XyWQwx9hwplSUJT-xEK0de3rAizByAWph2ezo1Kjzp2p1LqbrJ97VpBbvy0d0RDU7qNw Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: fef76eedbb014e64a2a61df170001185 Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesNegativeTest-1506751520 Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:58:44.956013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fef76eedbb014e64a2a61df170001185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fef76eedbb014e64a2a61df170001185"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fef76eedbb014e64a2a61df170001185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fef76eedbb014e64a2a61df170001185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesNegativeTest-1506751520 Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: fef76eedbb014e64a2a61df170001185 Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesNegativeTest-1506751520 Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesNegativeTest-1506751520-project Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: f56ddee9ed6b403f947205b533a89a5a Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesNegativeTest-1506751520-project Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 could not be found. Jul 14 10:58:44.957431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '5bda806c-5ade-47ab-bea9-1ba0fe721724'} Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 could not be found. Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:58:44.958215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 could not be found. Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 could not be found. Jul 14 10:58:44.959437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:58:44.963330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] Returning 404 to user: Instance 5bda806c-5ade-47ab-bea9-1ba0fe721724 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:58:44.964604 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ab342be0-0d73-43ff-8d27-25de881559c3 tempest-VolumesNegativeTest-1506751520 tempest-VolumesNegativeTest-1506751520-project] 10.222.0.27 "GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724" status: 404 len: 111 microversion: 2.1 time: 0.131885 Jul 14 10:58:44.965484 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 133/266] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:44 2022] GET /compute/v2.1/servers/5bda806c-5ade-47ab-bea9-1ba0fe721724 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:58:45.337420 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:45.352091 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-228c16d6-3dbf-47d7-96d2-15abec47bedb tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1723 microversion: 2.1 time: 0.959265 Jul 14 10:58:45.353205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 134/267] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:44 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1723 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:45.414288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:45.416815 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:45.426144 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:45.427039 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:45.431283 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:45.432472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:45.745609 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:45.747048 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:45.759565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:45.760540 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:45.761599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:45.762163 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:45.780048 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:45.794565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:45.797180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:45.798694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7dfc0d22-3289-4ce9-8811-b854bc683bfe tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.392568 Jul 14 10:58:45.800267 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 134/268] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:45 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:45.937164 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:45.945717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4a8dcbf1-629f-4e38-ba4d-6cf087fab794 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1272 microversion: 2.1 time: 0.204733 Jul 14 10:58:45.955492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 135/269] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:45 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:46.017188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ee5e7199-13ff-4cf8-81cf-9afeabdb312a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'create', calling method: .version_select at 0x7f13d45a9040>, body: {"keypair": {"name": "tempest-keypair-443606166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAM2dhVlRpajh7+xoLcVho93ZSLS72KiOl8VSE+b19GpolRLyYqRflVGnxnZRCLFDCqJFEAbkUV0Ur+Yy7vgA8rtZoZOf1c2Q47ObrsgRG98EtAHi7G957tfK/FVlN81g=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:46.033567 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-ee5e7199-13ff-4cf8-81cf-9afeabdb312a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for project c2d5301114244be2a74210484c6536ef. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:58:46.037853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-ee5e7199-13ff-4cf8-81cf-9afeabdb312a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for user b47991b6880c4a91ab42d2567eee61aa and project c2d5301114244be2a74210484c6536ef. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:58:46.061081 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ee5e7199-13ff-4cf8-81cf-9afeabdb312a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048012 Jul 14 10:58:46.061958 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 135/270] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 10:58:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:58:46.372425 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:46.373030 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:46.380085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:46.380715 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:46.381732 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:46.382419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:46.716981 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:46.735713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6a09e5f6-4b2c-4b1d-92b9-33b0292ae16a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1700 microversion: 2.1 time: 0.365051 Jul 14 10:58:46.736389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 136/271] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:46 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1700 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:46.759761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0fd3e5d6-e618-41d6-bbc9-2e5caf6516f4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:46.770727 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0fd3e5d6-e618-41d6-bbc9-2e5caf6516f4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:46.771962 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0fd3e5d6-e618-41d6-bbc9-2e5caf6516f4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:46.820229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:46.820897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:46.833246 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:46.836823 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:46.838154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:46.840404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:46.913739 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0fd3e5d6-e618-41d6-bbc9-2e5caf6516f4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Going to try to start instance {{(pid=133220) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 10:58:47.001357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0fd3e5d6-e618-41d6-bbc9-2e5caf6516f4 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action" status: 202 len: 0 microversion: 2.1 time: 0.249915 Jul 14 10:58:47.001970 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 136/272] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 10:58:46 2022] POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:58:47.010403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:47.011394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:47.025428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:47.030496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:47.031643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:47.032273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:47.408463 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:47.418550 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:47.420585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:47.421849 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-898168aa-7b92-49f3-a574-faedefdab00f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.608903 Jul 14 10:58:47.422498 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 137/273] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:46 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:47.431108 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:47.432824 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:47.441039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:47.442231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:47.443182 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:47.444319 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:47.677100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:47.695788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1fb3cb04-08e4-4b83-8004-6c7bb5d3584c tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.692255 Jul 14 10:58:47.697103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 137/274] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:47 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:48.044209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:48.055201 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bf30c7f4-b793-470f-8764-ce6c37716bbc tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1709 microversion: 2.1 time: 0.628101 Jul 14 10:58:48.056149 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 138/275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:47 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1709 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:48.440289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:48.441552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:48.449751 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:48.450552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:48.451752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:48.452396 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:48.723395 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:48.724313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:48.745843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:48.746563 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:48.748094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:48.753725 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:49.461528 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:49.471769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:49.473625 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:49.475093 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-71020b6f-ae8a-4b43-895f-fb23d8a36bb2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 1.039083 Jul 14 10:58:49.475671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 138/276] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:48 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:49.486782 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:49.487667 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:49.494473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:49.494922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:49.495699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:49.496181 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:49.716658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:49.725581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a257fef5-970c-485d-bd28-40ed27bb3e04 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 1.007481 Jul 14 10:58:49.726200 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 139/277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:48 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:49.740828 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-4064eafb-6592-46d9-af95-e79923a8dd54 req-862fa70c-6003-4802-aa29-24a0ed82db69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d", "tag": "53c83db4-51bf-4af5-9863-61b48a416a74"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:49.749845 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-4064eafb-6592-46d9-af95-e79923a8dd54 req-862fa70c-6003-4802-aa29-24a0ed82db69 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:49.750298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-4064eafb-6592-46d9-af95-e79923a8dd54 req-862fa70c-6003-4802-aa29-24a0ed82db69 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:49.761511 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-4064eafb-6592-46d9-af95-e79923a8dd54 req-862fa70c-6003-4802-aa29-24a0ed82db69 service nova] Creating event network-changed:53c83db4-51bf-4af5-9863-61b48a416a74 for instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d on hv-cinder-84614 Jul 14 10:58:49.766566 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-4064eafb-6592-46d9-af95-e79923a8dd54 req-862fa70c-6003-4802-aa29-24a0ed82db69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029139 Jul 14 10:58:49.767471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 140/278] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:49.908957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:49.917357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2c549b08-23fc-4a73-88c8-b4911aa7b08b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1709 microversion: 2.1 time: 0.439487 Jul 14 10:58:49.918049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 139/279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:49 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1709 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:49.944576 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0657e48e-e7d8-43fe-bcf5-a69ed56f56b4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Action: 'create', calling method: .version_select at 0x7f13d4893dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1318760041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3R+J+4YNX39TfIc1l7GoP7KKzadLVKlJLcIPIEdUA/CAEBcjhRQ/RiGewSM9Oa9sfAkP6yQ0QSqjzvrLc5qaEpSuEAo0IAzSvociAYKZb8O3tDPfOG2lqxKhLHH177bg=="}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:49.959789 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-0657e48e-e7d8-43fe-bcf5-a69ed56f56b4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Getting quotas for project 3d2953bf079541b28189cc9ad88ad753. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:58:49.970290 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-0657e48e-e7d8-43fe-bcf5-a69ed56f56b4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Getting quotas for user 600fb1135fe040e2aa1c03628da8bf93 and project 3d2953bf079541b28189cc9ad88ad753. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:58:50.000358 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0657e48e-e7d8-43fe-bcf5-a69ed56f56b4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.231593 Jul 14 10:58:50.003911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 141/280] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 10:58:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:50.494936 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:50.496446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:50.504087 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:50.504695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:50.505599 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:50.506141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:50.740497 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:50.750571 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:50.753084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:50.776308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:50.776758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:50.777535 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:50.778613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:50.786027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:50.800750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:50.807095 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:50.810705 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e9ba78b0-a5f7-4c19-992c-3a812ff3587b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.320272 Jul 14 10:58:50.813218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 140/281] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:50 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:50.936876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:50.937496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:50.951163 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:50.952903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:50.955315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:50.956804 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:51.130359 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:51.147512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-79f2316f-e0f3-4ae0-87eb-afb782adf951 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.406776 Jul 14 10:58:51.150115 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 142/282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:50 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:51.191853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1851331875", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eae5d0eb-0b14-432c-84e3-b58be5ccf17f"}], "security_groups": [{"name": "tempest-securitygroup--214660908"}], "key_name": "tempest-keypair-443606166", "user_data": "}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:51.261554 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:51.270711 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ead5cbaa-3fe4-4462-8beb-8ec9296a5abe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1713 microversion: 2.1 time: 0.338374 Jul 14 10:58:51.271898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 141/283] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:50 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1713 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:51.342308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] validate_networks() for [('eae5d0eb-0b14-432c-84e3-b58be5ccf17f', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:58:51.839049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:51.839660 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:51.847742 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:51.848251 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:51.849021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:51.849502 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:51.908077 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:58:51.917281 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:58:51.918308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:58:51.918886 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:58:51.919429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:58:51.930498 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:51.931191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:51.932175 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:51.932755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:51.956119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for project c2d5301114244be2a74210484c6536ef. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:58:51.971803 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Getting quotas for user b47991b6880c4a91ab42d2567eee61aa and project c2d5301114244be2a74210484c6536ef. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:58:51.999338 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:58:52.003649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:58:52.073637 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e59462e2-1099-4aed-9fde-88352adcf6d4 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.887697 Jul 14 10:58:52.074943 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 143/284] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:58:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:58:52.086585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-70e83fc1-0653-4817-b26b-1499c55690f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:52.087591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-70e83fc1-0653-4817-b26b-1499c55690f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:52.213075 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-70e83fc1-0653-4817-b26b-1499c55690f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:52.237724 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-70e83fc1-0653-4817-b26b-1499c55690f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1245 microversion: 2.1 time: 0.144325 Jul 14 10:58:52.240116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 144/285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:52 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:52.249337 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:52.255294 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:52.267399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:52.269401 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:52.271643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:52.274383 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-32f96885-c3d6-4171-8e25-aed68ed2bb58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.443777 Jul 14 10:58:52.277997 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 142/286] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:51 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:52.289537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:52.290259 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:52.291337 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:52.292057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:52.557995 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:52.568446 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-df8b2d69-151b-41fd-b763-44d1646e6456 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.324466 Jul 14 10:58:52.569031 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 145/287] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:52 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:53.263948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:53.286269 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:53.297688 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:53.298795 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:53.309659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:53.322018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:53.322916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:53.323261 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:53.323500 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:53.324060 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:53.324362 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:53.325706 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:53.767955 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:53.776986 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-35559bdb-f612-47a9-94fb-8f26e0f756ea tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1297 microversion: 2.1 time: 0.521875 Jul 14 10:58:53.787496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 143/288] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:53 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1297 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:53.794136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:53.795136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:53.803279 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:53.803898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:53.804798 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:53.805369 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:53.951916 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:53.961087 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:53.962892 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:53.964229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8a36884a-c871-4a48-87aa-2096558a6dd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1745 microversion: 2.20 time: 0.673614 Jul 14 10:58:53.975915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 146/289] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:53 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1745 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:54.078665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:54.087891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-00e10190-2110-4fc2-a22a-26b55ba9c535 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.298905 Jul 14 10:58:54.089034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 144/290] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:53 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:54.798066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:54.799271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:54.809990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:54.810476 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:54.816125 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:54.816722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:54.984047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:54.984818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:54.992021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:54.992748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:54.993802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:54.994391 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:55.340161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:55.350128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9201d615-ab86-4066-97a8-87348262d6da tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.558447 Jul 14 10:58:55.351010 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:55.351165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 147/291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:54 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:55.356337 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:55.356957 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:55.364027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:55.364440 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:55.365587 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:55.366179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:55.369156 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:55.392504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:55.411778 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:55.413292 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-96403b50-90f2-41ce-918d-23bc8be8f4cb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.433394 Jul 14 10:58:55.424281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 145/292] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:54 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:58:55.605238 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:55.616588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-509c782c-31cf-4129-96bb-4030b394f82a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.264169 Jul 14 10:58:55.617624 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 148/293] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:55 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:56.008882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-ea969569-e729-4472-9fb8-cc5a40b922b4 req-ddea9b28-986f-44bd-8789-a366f3642609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9aa3e5-a93c-4850-808e-789d7637d049", "tag": "ca5f8bad-44e3-4e53-a1c5-9a328af00a8f"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:56.039910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-ea969569-e729-4472-9fb8-cc5a40b922b4 req-ddea9b28-986f-44bd-8789-a366f3642609 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.040909 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-ea969569-e729-4472-9fb8-cc5a40b922b4 req-ddea9b28-986f-44bd-8789-a366f3642609 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.041137 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-46de4b1e-e8b6-4d26-bd1c-1b71ac3a4511 req-f1b59796-42ce-4124-b050-7f251c37006d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "name": "network-vif-plugged", "status": "completed", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:56.058276 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:56.063142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-ea969569-e729-4472-9fb8-cc5a40b922b4 req-ddea9b28-986f-44bd-8789-a366f3642609 service nova] Creating event network-changed:ca5f8bad-44e3-4e53-a1c5-9a328af00a8f for instance 8f9aa3e5-a93c-4850-808e-789d7637d049 on hv-cinder-84614 Jul 14 10:58:56.067570 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-46de4b1e-e8b6-4d26-bd1c-1b71ac3a4511 req-f1b59796-42ce-4124-b050-7f251c37006d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.071885 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-46de4b1e-e8b6-4d26-bd1c-1b71ac3a4511 req-f1b59796-42ce-4124-b050-7f251c37006d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.072480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-ea969569-e729-4472-9fb8-cc5a40b922b4 req-ddea9b28-986f-44bd-8789-a366f3642609 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067716 Jul 14 10:58:56.073779 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 146/294] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:56.114929 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-46de4b1e-e8b6-4d26-bd1c-1b71ac3a4511 req-f1b59796-42ce-4124-b050-7f251c37006d service nova] Creating event network-vif-plugged:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 10:58:56.124233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-46de4b1e-e8b6-4d26-bd1c-1b71ac3a4511 req-f1b59796-42ce-4124-b050-7f251c37006d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087513 Jul 14 10:58:56.132806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 149/295] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:56.370583 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:56.371486 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:56.382299 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.382728 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.383523 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.389568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.447902 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:56.448875 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:56.458620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.463912 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.465028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.465663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.759579 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:56.766776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:56.767639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8c1e6f46-db18-48e7-8107-1cc62046028f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.402400 Jul 14 10:58:56.777108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:56 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:56.777594 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:56.783866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:56.785825 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:56.786424 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:56.787694 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-17f69bce-9153-4e64-9612-6ccd2ff39277 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.347047 Jul 14 10:58:56.796616 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 150/297] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:56 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:56.801169 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.801811 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:56.803027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:56.803466 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:57.002978 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:57.012223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1ae55a0e-7e5d-451b-81b8-7d7f5817c00a tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.241847 Jul 14 10:58:57.013956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 148/298] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:56 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:57.785295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:57.785889 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:57.797065 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:57.797897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:57.798699 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:57.799137 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:57.811566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:57.812496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:57.819323 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:57.822280 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:57.823167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:57.823782 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:58.144435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:58.162593 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7825c65b-1f63-4e7c-8194-aadd1f44d55a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.381190 Jul 14 10:58:58.174083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 151/299] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:57 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:58.185746 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:58.187384 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:58.193565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:58.214996 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:58.222556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:58.223774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-09446df7-6b87-456d-9b3a-eb67338425a8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.418824 Jul 14 10:58:58.224825 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 149/300] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:57 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:58.225751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:58.226216 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:58.227001 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:58.227435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:58.230268 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-04a7b1b9-3df3-4384-9198-4a6db4d26040 req-54f97279-2527-4b4a-81f1-a57a924d1e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d", "name": "network-vif-plugged", "status": "completed", "tag": "53c83db4-51bf-4af5-9863-61b48a416a74"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:58:58.240551 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-04a7b1b9-3df3-4384-9198-4a6db4d26040 req-54f97279-2527-4b4a-81f1-a57a924d1e81 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:58.241568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-04a7b1b9-3df3-4384-9198-4a6db4d26040 req-54f97279-2527-4b4a-81f1-a57a924d1e81 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:58.253970 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:58.257126 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-04a7b1b9-3df3-4384-9198-4a6db4d26040 req-54f97279-2527-4b4a-81f1-a57a924d1e81 service nova] Creating event network-vif-plugged:53c83db4-51bf-4af5-9863-61b48a416a74 for instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d on hv-cinder-84614 Jul 14 10:58:58.263453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-04a7b1b9-3df3-4384-9198-4a6db4d26040 req-54f97279-2527-4b4a-81f1-a57a924d1e81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037165 Jul 14 10:58:58.264185 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 150/301] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:58:58.600917 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:58.610038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-906f7e2a-bbb9-4046-b122-123c9eb69d42 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.434282 Jul 14 10:58:58.610808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 152/302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:58 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:58:59.181010 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:59.181810 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:59.189601 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:59.190129 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:59.190971 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:59.191474 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:59.242821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:59.244375 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:59.251945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:59.252717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:59.253607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:59.254043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:59.395907 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:59.406179 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ead75e24-e21a-43a1-b41b-3c7ac8dc3f3a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.230144 Jul 14 10:58:59.420502 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 151/303] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:59 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:58:59.486910 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:59.496960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:59.498613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:59.499838 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ad5e1edd-bf82-4dc3-b944-7d1e407e4efd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.261265 Jul 14 10:58:59.511751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 153/304] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:58:59 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:58:59.630273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:58:59.630987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:58:59.637888 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:59.638373 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:59.639241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:58:59.639771 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:58:59.878973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:58:59.889995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-35a9cec0-74c3-48c9-a38e-c23c3fd6f223 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1314 microversion: 2.1 time: 0.267085 Jul 14 10:58:59.890693 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 152/305] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:58:59 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:00.429581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:00.430304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:00.437890 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:00.439264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:00.440621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:00.447799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:00.519765 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:00.521669 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:00.542855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:00.545600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:00.546582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:00.547033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:00.708509 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:00.725263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0f6a5f3d-c308-447e-924f-bc7d13713a02 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.299703 Jul 14 10:59:00.735018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 154/306] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:00 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:00.763311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:00.775175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:00.777152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:00.778492 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f06ffa0d-10fe-4f54-b72d-c1e37c080cfa tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.263853 Jul 14 10:59:00.790151 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 153/307] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:00 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:59:00.909572 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:00.918861 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:00.919420 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:00.920015 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:00.920801 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:00.921241 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.086390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:01.095405 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ce7f8ca1-8cd1-41a8-99d0-c3f5d28897d0 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1497 microversion: 2.1 time: 0.189653 Jul 14 10:59:01.095906 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 155/308] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:00 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:01.642819 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:01.644042 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:01.651020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:01.651756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.652872 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:01.653542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.679319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:59:01.744238 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:01.745802 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:01.761145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:01.763659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.764873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:01.781789 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.783611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1b96646a-6a68-409b-bc2d-932ff3426aa7 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 204 len: 0 microversion: 2.1 time: 0.144686 Jul 14 10:59:01.784349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 154/309] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 10:59:01 2022] DELETE /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:59:01.794156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:01.795205 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:01.802599 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:01.803304 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.804303 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:01.804880 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:01.945482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:02.037978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:02.055009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bc701dc1-6e7d-4d8b-bc20-4ef5023df60a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.315714 Jul 14 10:59:02.060653 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 156/310] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:01 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:02.073875 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:02.074547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:02.087018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:02.087476 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:02.091173 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:02.092590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:02.116564 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:02.126243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ebb5b36c-73e6-4659-89a9-74d83904d289 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1503 microversion: 2.1 time: 0.336353 Jul 14 10:59:02.127492 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 155/311] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:01 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:02.132759 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-23db5bce-a574-4b8a-b09c-01ad219709b6 req-264ee898-79f0-49de-bb20-a7a4b0047c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9aa3e5-a93c-4850-808e-789d7637d049", "name": "network-vif-plugged", "status": "completed", "tag": "ca5f8bad-44e3-4e53-a1c5-9a328af00a8f"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:02.138750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:02.148719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-23db5bce-a574-4b8a-b09c-01ad219709b6 req-264ee898-79f0-49de-bb20-a7a4b0047c30 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:02.148913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-23db5bce-a574-4b8a-b09c-01ad219709b6 req-264ee898-79f0-49de-bb20-a7a4b0047c30 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:02.163645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-23db5bce-a574-4b8a-b09c-01ad219709b6 req-264ee898-79f0-49de-bb20-a7a4b0047c30 service nova] Creating event network-vif-plugged:ca5f8bad-44e3-4e53-a1c5-9a328af00a8f for instance 8f9aa3e5-a93c-4850-808e-789d7637d049 on hv-cinder-84614 Jul 14 10:59:02.169543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-23db5bce-a574-4b8a-b09c-01ad219709b6 req-264ee898-79f0-49de-bb20-a7a4b0047c30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040555 Jul 14 10:59:02.170571 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 156/312] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:02.224327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=20 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:02.252817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:02.261539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:02.263220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:02.264504 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3b192d33-ef08-4481-ba31-87758486592d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.202651 Jul 14 10:59:02.265235 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 157/313] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:02 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:03.085400 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:03.085400 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:03.093111 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:03.093700 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:03.095460 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:03.096037 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:03.149851 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:03.151125 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:03.159373 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:03.173433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:03.177274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:03.179156 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:03.461143 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:03.468860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4349fc91-89ed-4dba-ac89-b70b87cb49c2 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.393690 Jul 14 10:59:03.469944 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 157/314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:03 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:03.476297 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:03.478043 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:03.485069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:03.485973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:03.486954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:03.487612 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:03.527503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:03.537223 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8256247c-9c32-429e-8bf8-70145e49b164 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1503 microversion: 2.1 time: 0.396367 Jul 14 10:59:03.538474 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 158/315] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:03 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1503 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:03.820712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:03.829767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:03.831286 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:03.865438 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e879e1dd-f337-4bcc-80c6-ace655347a01 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.394162 Jul 14 10:59:03.877052 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 158/316] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:03 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:04.208306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-efa0555c-513d-4b2a-b35d-d57190f7086a req-a6e10156-2d4d-4a14-acf0-42eabdea633b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d", "name": "network-vif-deleted", "tag": "53c83db4-51bf-4af5-9863-61b48a416a74"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:04.217313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-efa0555c-513d-4b2a-b35d-d57190f7086a req-a6e10156-2d4d-4a14-acf0-42eabdea633b service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.218724 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-efa0555c-513d-4b2a-b35d-d57190f7086a req-a6e10156-2d4d-4a14-acf0-42eabdea633b service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.231782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-efa0555c-513d-4b2a-b35d-d57190f7086a req-a6e10156-2d4d-4a14-acf0-42eabdea633b service nova] Creating event network-vif-deleted:53c83db4-51bf-4af5-9863-61b48a416a74 for instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d on hv-cinder-84614 Jul 14 10:59:04.244024 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-efa0555c-513d-4b2a-b35d-d57190f7086a req-a6e10156-2d4d-4a14-acf0-42eabdea633b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039389 Jul 14 10:59:04.244698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 159/317] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:04.487327 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:04.487940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:04.495709 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.496474 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.497149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.497592 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.557899 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:04.560919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:04.568617 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.569373 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.570839 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.572572 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.610591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.611296 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.612090 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lazy-loading 'fault' on Instance uuid bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:59:04.692818 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7f7af47db49d9a30db75c76980cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a913265f84c43579ce0fb5a2604b663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:04.700721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3ecb4d76-9d32-4bcf-9000-6d14d4e8a132 tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 200 len: 1304 microversion: 2.1 time: 0.149895 Jul 14 10:59:04.701803 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 160/318] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:04 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:04.743092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:04.753118 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c1d3eaf2-8b83-44b1-8f53-b59cee460908 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1370 microversion: 2.1 time: 0.270247 Jul 14 10:59:04.754314 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 159/319] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:04 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:04.884471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:04.885153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:04.891513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.891929 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:04.892733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:04.893494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:05.044009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:05.056434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:05.069936 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:05.072504 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-11a2bf55-ece2-4805-92cf-78717ed9d42c tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1740 microversion: 2.20 time: 0.192681 Jul 14 10:59:05.084257 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 161/320] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:04 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:05.717961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:05.718561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] [instance: bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:05.725329 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:05.725787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:05.726561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:05.726998 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:05.741113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] HTTP exception thrown: Instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d could not be found. Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Request method failure captured: Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d HTTP/1.1 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_bK9MAxHn6QpmfHGkrmwwkF89atEku0w_8gFKWyqpD47iPwChkvjSIoZf8l4p7-e4fCZ_zzFZfqI2C671_T3g570bjxmhCtLiS9RqBM9_RHFYk5hXyD08z1QrsMXvriSQncykpCG2wxTzhuh5lelvKqVmlZpgHpk4qwmK5CzACcP20 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 8a913265f84c43579ce0fb5a2604b663 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesActionsTest-583233254 Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 10:59:05.742754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a913265f84c43579ce0fb5a2604b663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesActionsTest-583233254 Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 8a913265f84c43579ce0fb5a2604b663 Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesActionsTest-583233254 Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesActionsTest-583233254-project Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: a7d7f7af47db49d9a30db75c76980cb9 Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesActionsTest-583233254-project Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d could not be found. Jul 14 10:59:05.744421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d'} Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d could not be found. Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:59:05.748316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d could not be found. Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d could not be found. Jul 14 10:59:05.749713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 10:59:05.750845 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] Returning 404 to user: Instance bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:59:05.750845 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8f80c350-0c3b-423c-96fa-4e8cdc296d7e tempest-VolumesActionsTest-583233254 tempest-VolumesActionsTest-583233254-project] 10.222.0.27 "GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d" status: 404 len: 111 microversion: 2.1 time: 0.030583 Jul 14 10:59:05.750845 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 160/321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:05 2022] GET /compute/v2.1/servers/bfd0aaa6-6c37-4b1b-97b2-1f6545c54c6d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:59:05.772903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:05.773527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:05.779848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:05.780355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:05.781205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:05.781643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:05.924882 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:05.932465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-95d94aa2-c4f4-4f64-a45f-02520aa6428c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1565 microversion: 2.1 time: 0.163961 Jul 14 10:59:05.933025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 162/322] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:05 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:05.949520 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:05.950019 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:05.956940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:05.958762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:05.959802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:05.960420 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:06.041848 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c67444bc-1f27-4250-9f26-1cee6adf4c69 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096566 Jul 14 10:59:06.042565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 161/323] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 10:59:05 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:59:06.091717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:06.092461 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:06.099353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:06.100107 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:06.100997 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:06.101527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:06.720022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:06.728568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:06.730136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:06.731287 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f874441e-4211-4ad7-ab2a-3ede496a484e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1722 microversion: 2.20 time: 0.643601 Jul 14 10:59:06.731861 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 163/324] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:06 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1722 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:07.524871 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-0ba34126-3c77-48ad-8ffb-66ea1638c8e3 req-3888d3c6-54c0-46bb-911d-d543653849af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9aa3e5-a93c-4850-808e-789d7637d049", "tag": "ca5f8bad-44e3-4e53-a1c5-9a328af00a8f"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:07.533676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-0ba34126-3c77-48ad-8ffb-66ea1638c8e3 req-3888d3c6-54c0-46bb-911d-d543653849af service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:07.534122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-0ba34126-3c77-48ad-8ffb-66ea1638c8e3 req-3888d3c6-54c0-46bb-911d-d543653849af service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:07.545932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-0ba34126-3c77-48ad-8ffb-66ea1638c8e3 req-3888d3c6-54c0-46bb-911d-d543653849af service nova] Creating event network-changed:ca5f8bad-44e3-4e53-a1c5-9a328af00a8f for instance 8f9aa3e5-a93c-4850-808e-789d7637d049 on hv-cinder-84614 Jul 14 10:59:07.552128 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-0ba34126-3c77-48ad-8ffb-66ea1638c8e3 req-3888d3c6-54c0-46bb-911d-d543653849af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031815 Jul 14 10:59:07.552730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 162/325] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:07.751471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:07.752147 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:07.754297 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:07.759766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:07.760295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:07.761074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:07.761514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:07.897745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:07.906308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:07.908022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:07.909343 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9396d7c3-f791-4478-ab14-e099204cabb6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1722 microversion: 2.20 time: 0.162160 Jul 14 10:59:07.909907 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 164/326] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:07 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:08.929339 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:08.930148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:08.936828 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:08.937325 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:08.938446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:08.938989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:09.074350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:09.083353 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:09.087160 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:09.088589 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9c547a12-675e-4100-a494-4807b9de1e47 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1722 microversion: 2.20 time: 0.164233 Jul 14 10:59:09.089167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 163/327] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:08 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:09.977160 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-cb6317d8-3d41-4ad0-8f14-4524c34915b9 req-f6d28222-aae4-4009-ab74-85b763a79752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "name": "network-vif-unplugged", "status": "completed", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:09.986177 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-cb6317d8-3d41-4ad0-8f14-4524c34915b9 req-f6d28222-aae4-4009-ab74-85b763a79752 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:09.986794 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-cb6317d8-3d41-4ad0-8f14-4524c34915b9 req-f6d28222-aae4-4009-ab74-85b763a79752 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:10.006417 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-cb6317d8-3d41-4ad0-8f14-4524c34915b9 req-f6d28222-aae4-4009-ab74-85b763a79752 service nova] Creating event network-vif-unplugged:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 10:59:10.011750 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-cb6317d8-3d41-4ad0-8f14-4524c34915b9 req-f6d28222-aae4-4009-ab74-85b763a79752 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038486 Jul 14 10:59:10.012630 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 165/328] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:10.108532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:10.109141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:10.115847 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:10.116309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:10.117062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:10.117487 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:10.430164 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:10.439156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:10.440686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:10.441844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d3bb54cf-63ab-4cc5-b5cc-6361b7a70e1a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1722 microversion: 2.20 time: 0.337338 Jul 14 10:59:10.442409 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 164/329] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:10 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:11.461539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:11.462177 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:11.479335 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:11.479782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:11.480706 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:11.481139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:11.497467 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:11.581785 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-508547317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1318760041", "security_groups": [{"name": "tempest-secgroup-smoke-1782185198"}], "networks": [{"uuid": "a1ade9b1-3300-45fe-b0e1-3699b69bbf78"}], "block_device_mapping_v2": [{"uuid": "052b8f76-5097-40f8-a46a-c10fda9b0e76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:11.732082 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:11.745435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:11.748284 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:11.749959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-97b851e2-2757-4c77-b637-7104bcd87681 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1722 microversion: 2.20 time: 0.293128 Jul 14 10:59:11.761910 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 166/330] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:11 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:11.777765 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] validate_networks() for [('a1ade9b1-3300-45fe-b0e1-3699b69bbf78', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:59:12.219221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:59:12.219676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:59:12.220217 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:59:12.220628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:59:12.221048 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:59:12.232977 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:12.233428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:12.236824 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:12.237268 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:12.257215 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Getting quotas for project 3d2953bf079541b28189cc9ad88ad753. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:59:12.260300 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Getting quotas for user 600fb1135fe040e2aa1c03628da8bf93 and project 3d2953bf079541b28189cc9ad88ad753. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:59:12.322708 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:59:12.324875 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='052b8f76-5097-40f8-a46a-c10fda9b0e76',volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:59:12.487662 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-218052b5-cb5f-4443-812e-67bc85f55b19 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.910081 Jul 14 10:59:12.493149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 165/331] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 10:59:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:59:12.502292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-14502d32-be12-4c9a-967f-1566fb36d679 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:12.508045 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-14502d32-be12-4c9a-967f-1566fb36d679 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:12.600711 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-14502d32-be12-4c9a-967f-1566fb36d679 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:12.611719 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-14502d32-be12-4c9a-967f-1566fb36d679 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1088 microversion: 2.1 time: 0.114885 Jul 14 10:59:12.613264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 167/332] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:12 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1088 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:12.777963 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:12.779447 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:12.787735 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:12.788492 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:12.789532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:12.789973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:12.980407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:12.991124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:12.993299 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:12.995319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-bf4379ed-693e-4a06-a64b-1917469eac28 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1725 microversion: 2.20 time: 0.230119 Jul 14 10:59:12.996493 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 166/333] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:12 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:13.023368 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b9a79b8-114b-4a97-bd72-0be543ca7313"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:13.024532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:13.039724 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.040575 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.041792 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.042601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.493669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-09f3b6c1-d161-4d48-83e1-a2f0d2d77bb8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.475190 Jul 14 10:59:13.495974 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 168/334] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jul 14 10:59:13 2022] POST /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments => generated 188 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:59:13.632167 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:13.633292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:13.634064 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:13.635098 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:13.646768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.648142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.648964 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.649546 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.650381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.650590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.651389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.652340 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.780343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:13.794785 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f94157f2-855c-4b59-abe7-d00a0993b856 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1186 microversion: 2.1 time: 0.167391 Jul 14 10:59:13.796928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 167/335] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:13 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1186 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:13.801960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-312f0051-a44d-4c8c-af88-6aa9732688b5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/action" status: 202 len: 0 microversion: 2.20 time: 0.173692 Jul 14 10:59:13.803085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 169/336] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 10:59:13 2022] POST /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 10:59:13.812197 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:13.815552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:13.840281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.852191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:13.852395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:13.852831 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:14.186464 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:14.186831 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:14.202702 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:14.204758 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:14.205808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b585e154-15b0-4141-a369-cbfb7b0934ec tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1751 microversion: 2.20 time: 0.398453 Jul 14 10:59:14.206561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 168/337] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:13 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1751 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:14.815535 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:14.817746 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:14.829992 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:14.830757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:14.840332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:14.841000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:14.996537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:15.017211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-79b984de-54ae-4551-a549-10814a25c3e1 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1192 microversion: 2.1 time: 0.206353 Jul 14 10:59:15.017948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 170/338] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:14 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1192 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:15.230764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:15.231734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:15.241691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:15.242463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:15.243237 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:15.243665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:15.674369 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:15.696211 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:15.698238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:15.699722 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8d51205c-4bc2-4c4b-9b72-c4f4b1d7b370 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1751 microversion: 2.20 time: 0.473710 Jul 14 10:59:15.700636 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 169/339] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:15 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1751 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:16.034887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:16.036259 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:16.042873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:16.043557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:16.044348 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:16.045011 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:16.357844 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:16.368364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-eccd53cc-a24d-492a-85ce-054d9f89df29 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.336179 Jul 14 10:59:16.371371 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 171/340] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:16 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:16.627110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-2a43752e-89bd-4d19-bfc7-1a7ac8e33b2d req-7ac024fd-11ca-4935-ae1d-7ec2ecb652b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:16.644317 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-2a43752e-89bd-4d19-bfc7-1a7ac8e33b2d req-7ac024fd-11ca-4935-ae1d-7ec2ecb652b7 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:16.644689 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-2a43752e-89bd-4d19-bfc7-1a7ac8e33b2d req-7ac024fd-11ca-4935-ae1d-7ec2ecb652b7 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:16.676523 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-2a43752e-89bd-4d19-bfc7-1a7ac8e33b2d req-7ac024fd-11ca-4935-ae1d-7ec2ecb652b7 service nova] Creating event network-changed:52a6868d-1e75-44e8-b0bb-7af3b70e050a for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 on hv-cinder-84614 Jul 14 10:59:16.686805 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-2a43752e-89bd-4d19-bfc7-1a7ac8e33b2d req-7ac024fd-11ca-4935-ae1d-7ec2ecb652b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064156 Jul 14 10:59:16.688387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 170/341] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:16.720385 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:16.721016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:16.743094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:16.743865 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:16.746505 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:16.749673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:16.971127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:16.982633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:16.984441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:16.986109 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e79c4431-d9cf-4aa5-8b14-db427d24ece5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.270944 Jul 14 10:59:16.999381 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 172/342] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:16 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:17.394750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:17.395805 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:17.414243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:17.415042 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:17.416068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:17.416508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:17.822659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:17.834539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-93b1999b-2495-496d-8f1e-330b93e77f8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.448529 Jul 14 10:59:17.835140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 171/343] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:17 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:18.007920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:18.008790 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:18.015776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:18.016309 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:18.017170 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:18.017581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:18.361355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:18.376234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:18.381020 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:18.383825 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-096f14e6-de43-430c-98a7-82453f009be4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.380246 Jul 14 10:59:18.385452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 173/344] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:18 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:18.851509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:18.852271 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:18.865138 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:18.867719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:18.868673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:18.870906 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:19.111128 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:19.123171 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-274a374f-ab19-49af-815d-2640702d40f3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.276130 Jul 14 10:59:19.123863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 172/345] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:18 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:19.402980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:19.404833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:19.412655 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:19.413340 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:19.414949 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:19.415544 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:19.637246 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:19.661187 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:19.664922 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:19.668601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-af0a8511-9bfd-4312-a95c-2dc172d0e1a9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.268719 Jul 14 10:59:19.670074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 174/346] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:19 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:59:20.140992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:20.142337 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:20.149843 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:20.150561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:20.151531 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:20.152140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:20.411265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:20.423222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cfd9eea4-544f-4363-90dc-11928adf445b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.285944 Jul 14 10:59:20.424088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 173/347] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:20 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:20.690084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:20.690972 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:20.701665 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:20.702665 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:20.703481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:20.704146 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:20.933264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:20.951280 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:20.953292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:20.954652 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7d124e77-d340-49db-8377-6717d2fb00e1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.268635 Jul 14 10:59:20.955319 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 175/348] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:20 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:21.440555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:21.441175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:21.448701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:21.449469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:21.450628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:21.451250 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:21.612170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:21.622578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9e4fc324-4799-44c8-b57d-d07f2b37b396 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.185999 Jul 14 10:59:21.632676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 174/349] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:21 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:21.974173 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:21.974946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:21.984323 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:21.984985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:21.986282 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:21.986887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:22.202143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:22.212365 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:22.214512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:22.215797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-29b6c1c2-ebac-4f88-a1fd-efa524b8e27f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.246069 Jul 14 10:59:22.227111 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 176/350] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:21 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:22.640420 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:22.641248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:22.661138 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:22.662068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:22.664647 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:22.665242 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:22.666236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:22.666912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:22.967321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:22.978153 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e7813b01-e835-4a2f-86cf-70fa8c49c458 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.341399 Jul 14 10:59:22.987937 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 175/351] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:22 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:23.234878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:23.235699 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:23.241377 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:23.244019 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:23.244824 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:23.246025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:23.246698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:23.454229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:23.465946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:23.469429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:23.471713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8c2a13d6-547f-4cbc-9e68-53ed52db6dc5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.240810 Jul 14 10:59:23.473200 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 177/352] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:23 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:23.996020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:23.997696 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:24.006222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:24.007054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:24.008652 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:24.009553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:24.178038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:24.194065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4492c4c6-962c-4647-87ba-86831b315d9b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.201893 Jul 14 10:59:24.200335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 176/353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:23 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:24.491896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:24.492475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:24.509463 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:24.509907 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:24.510699 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:24.511128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:24.694011 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:24.704870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:24.706741 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:24.708888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3f3cccb1-c230-4b8e-a753-7596d1f21c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.220301 Jul 14 10:59:24.710124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 178/354] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:24 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:25.218470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:25.219378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:25.232951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:25.233972 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:25.235230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:25.235705 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:25.435597 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:25.444227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-460ea371-2b79-40d7-a3bf-0ea778a99c65 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.230614 Jul 14 10:59:25.464439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 177/355] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:25 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:25.727448 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:25.728224 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:25.744351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:25.745197 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:25.746234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:25.746897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:26.012714 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:26.022964 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:26.025348 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:26.026725 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-14baf15b-a3cd-487d-ab59-ae28a62753b3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.303309 Jul 14 10:59:26.027449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 179/356] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:25 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:26.462196 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:26.462855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:26.480387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:26.480959 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:26.481954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:26.482529 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:26.679368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:26.688110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a5935fef-3ec2-431e-98f0-e458f322cdb7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.230224 Jul 14 10:59:26.689429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 178/357] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:26 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:27.046174 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:27.047531 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:27.067928 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:27.068676 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:27.069671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:27.070262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:27.094691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:27.293399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:27.314356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:27.315920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:27.317136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d815a378-a651-4f74-9bfa-572fccb26d63 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.274938 Jul 14 10:59:27.317698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 180/358] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:27 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:27.706928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:27.707553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:27.713992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:27.714436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:27.715193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:27.715660 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:27.890843 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:27.898693 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-993f16d0-26a2-46e6-b61c-3e095b507cc4 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.195915 Jul 14 10:59:27.899257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 179/359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:27 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:28.335720 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:28.336335 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:28.342713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:28.343169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:28.344004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:28.344441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:28.486501 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:28.496694 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:28.498329 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:28.499902 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a3766289-1d4d-4039-a100-57aba294114a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.168142 Jul 14 10:59:28.500681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 181/360] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:28 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:28.934960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:28.935574 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:28.955661 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:28.956130 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:28.956907 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:28.957338 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:29.127411 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:29.136035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1c2f7d2c-aff3-442c-8e1c-f94e29fb430b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.225277 Jul 14 10:59:29.136690 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 180/361] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:28 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:59:29.518442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:29.519084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:29.525967 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:29.526411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:29.527170 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:29.527598 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:29.925497 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:29.934136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:29.935678 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:29.936868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5e104a4b-85a7-4087-bb3e-667fdbc5b941 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.422539 Jul 14 10:59:29.937414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 182/362] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:29 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:30.159319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:30.160255 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:30.171392 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:30.172251 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:30.173543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:30.173984 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:30.325549 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:30.333282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ee8ef1d1-2ad7-4e62-ac8b-1a2482e040e0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.181769 Jul 14 10:59:30.333826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 181/363] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:30 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:30.955683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:30.956278 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:30.963618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:30.964099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:30.964904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:30.965334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:31.166730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:31.176289 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:31.177972 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:31.179142 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c760349d-b6ab-42ee-b89c-aa5210944757 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.228348 Jul 14 10:59:31.179700 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 183/364] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:30 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:31.350559 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:31.351308 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:31.357465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:31.357915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:31.358715 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:31.359155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:31.533515 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:31.548423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-15f20b4a-6de3-4736-a600-f1b73e5ddf8e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.201925 Jul 14 10:59:31.549378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 182/365] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:31 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:32.198455 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:32.199059 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:32.205195 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:32.205630 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:32.206384 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:32.206813 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:32.341300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:32.350120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:32.351616 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:32.352800 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ab523c60-3920-4a00-b2e2-3061d6134f54 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.158213 Jul 14 10:59:32.353361 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 184/366] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:32 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:32.566519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:32.567126 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:32.570551 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:32.574461 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:32.574928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:32.575686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:32.576128 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:32.715999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:32.723960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f87b3e66-6c69-4c17-b249-3f03f24e621c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.161498 Jul 14 10:59:32.724360 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 183/367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:32 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:33.371402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:33.372039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:33.379599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:33.380228 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:33.381234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:33.382372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:33.526467 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:33.536400 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:33.537901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:33.539095 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b927157d-3435-4cbd-abe4-4eb7f67d8ab5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.171736 Jul 14 10:59:33.539647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 185/368] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:33 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:33.741910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:33.742504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:33.750021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:33.750493 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:33.751659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:33.752227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:33.898071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:33.906022 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-94513d12-45a2-4e44-8e79-1644b9e72c72 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.168263 Jul 14 10:59:33.906641 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 184/369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:33 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:34.558565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:34.559242 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:34.566606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:34.567062 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:34.567985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:34.568508 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:34.714409 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:34.726832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:34.729108 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:34.730788 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d920e66a-0f47-4b70-9680-f5f354c0b3d1 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.176114 Jul 14 10:59:34.731526 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 186/370] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:34 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:34.932334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:34.932954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:34.940377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:34.940832 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:34.941686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:34.942122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:35.093890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:35.104900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-84193461-0405-489e-8c13-60d80ea19f24 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.176038 Jul 14 10:59:35.105706 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 185/371] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:34 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:35.754332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:35.755197 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:35.761265 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:35.761714 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:35.762484 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:35.762915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:35.918881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:35.927727 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:35.929409 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:35.930880 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9748098c-0876-49b3-abfb-eed2f9469d58 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.182969 Jul 14 10:59:35.931948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 187/372] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:35 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:36.122923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:36.123791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:36.131323 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:36.131774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:36.132578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:36.133849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:36.136253 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=100 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:36.181866 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-0cdd4855-878e-4469-8908-ef5308a7f593 req-4737e8bd-fa5c-4547-b656-dcafdcdc586e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "name": "network-vif-plugged", "status": "completed", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:36.190324 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-0cdd4855-878e-4469-8908-ef5308a7f593 req-4737e8bd-fa5c-4547-b656-dcafdcdc586e service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:36.191153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-0cdd4855-878e-4469-8908-ef5308a7f593 req-4737e8bd-fa5c-4547-b656-dcafdcdc586e service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:36.204897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-0cdd4855-878e-4469-8908-ef5308a7f593 req-4737e8bd-fa5c-4547-b656-dcafdcdc586e service nova] Creating event network-vif-plugged:52a6868d-1e75-44e8-b0bb-7af3b70e050a for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 on hv-cinder-84614 Jul 14 10:59:36.210421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-0cdd4855-878e-4469-8908-ef5308a7f593 req-4737e8bd-fa5c-4547-b656-dcafdcdc586e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032651 Jul 14 10:59:36.211526 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 188/373] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:59:36.280391 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:36.290483 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8139d6e2-129d-4e9c-aa24-049f863054d8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.171155 Jul 14 10:59:36.291356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 186/374] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:36 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:36.950945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:36.951639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:36.958647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:36.959101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:36.959862 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:36.960361 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:37.102442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:37.111485 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:37.113097 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:37.114301 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e9daae32-dd58-4e2d-8a07-bdd16a704b98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.167826 Jul 14 10:59:37.114878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 189/375] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:36 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:37.313025 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:37.313763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:37.320475 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:37.320931 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:37.321707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:37.322143 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:37.469930 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:37.478547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-47938c46-c5f6-4724-903c-1bac80343594 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.169475 Jul 14 10:59:37.479129 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 187/376] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:37 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:38.136809 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:38.137415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:38.140365 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=56 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:38.149860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:38.150305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:38.151187 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:38.151617 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:38.311102 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:38.319991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:38.321496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:38.322657 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1c9f05ce-b990-47dd-9974-dbec24e455a4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.189850 Jul 14 10:59:38.323189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 190/377] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:38 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:38.495031 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:38.495589 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:38.502888 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:38.503344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:38.504156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:38.504595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:38.678659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:38.686836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c793dafc-a67d-4706-bf9e-0c50f5455d57 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1260 microversion: 2.1 time: 0.195683 Jul 14 10:59:38.687578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 188/378] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:38 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:39.343788 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:39.344393 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:39.351104 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:39.351543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:39.352354 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:39.352781 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:39.578626 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:39.590953 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:39.592803 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:39.594022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9443248d-ddb3-44c8-92d7-d8e518898ec6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.255170 Jul 14 10:59:39.594522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 191/379] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:39 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:39.704411 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:39.705200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:39.712673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:39.713160 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:39.714277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:39.714906 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:39.916913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:39.925119 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-19dee27a-8ed0-44bf-9677-3d244e4392ff tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1443 microversion: 2.1 time: 0.224398 Jul 14 10:59:39.925728 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 189/380] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:39 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1443 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:39.941966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:39.942722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:39.950124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:39.950581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:39.951378 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:39.951814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:40.102582 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:40.110010 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7bc67de2-e325-49d6-b29f-7440b7b9ec69 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1443 microversion: 2.1 time: 0.172024 Jul 14 10:59:40.110787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 192/381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 10:59:39 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1443 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:59:40.612932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:40.613619 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:40.620199 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:40.620559 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:40.621330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:40.621759 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:40.761888 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:40.771062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:40.772910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:40.774110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ddcac414-76a7-4bde-bd3f-a193b8da276e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.165528 Jul 14 10:59:40.774654 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 190/382] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:40 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:41.792913 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:41.793474 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:41.800422 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:41.801451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:41.801609 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:41.802052 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:41.950826 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:41.966300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:41.970033 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:41.972730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4705752e-e121-403d-a29a-f3f9cfaaf432 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.183514 Jul 14 10:59:41.973716 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 193/383] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:41 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:42.025144 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-704f485d-13f4-4bd9-b975-4d264a1922df req-9a8bd443-4615-41b3-8800-f2cb42350e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:42.034262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-704f485d-13f4-4bd9-b975-4d264a1922df req-9a8bd443-4615-41b3-8800-f2cb42350e3d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:42.034796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-704f485d-13f4-4bd9-b975-4d264a1922df req-9a8bd443-4615-41b3-8800-f2cb42350e3d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:42.048521 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-704f485d-13f4-4bd9-b975-4d264a1922df req-9a8bd443-4615-41b3-8800-f2cb42350e3d service nova] Creating event network-changed:52a6868d-1e75-44e8-b0bb-7af3b70e050a for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 on hv-cinder-84614 Jul 14 10:59:42.053620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-704f485d-13f4-4bd9-b975-4d264a1922df req-9a8bd443-4615-41b3-8800-f2cb42350e3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Jul 14 10:59:42.054353 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 191/384] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:42.418162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-da33d349-4c1b-48fc-b58b-eaceaa18940c req-e829d0d5-1c24-4bcf-9a46-754fb43d51eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "name": "network-vif-plugged", "status": "completed", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:42.430534 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-da33d349-4c1b-48fc-b58b-eaceaa18940c req-e829d0d5-1c24-4bcf-9a46-754fb43d51eb service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:42.431298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-da33d349-4c1b-48fc-b58b-eaceaa18940c req-e829d0d5-1c24-4bcf-9a46-754fb43d51eb service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:42.444581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-da33d349-4c1b-48fc-b58b-eaceaa18940c req-e829d0d5-1c24-4bcf-9a46-754fb43d51eb service nova] Creating event network-vif-plugged:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 10:59:42.450022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-da33d349-4c1b-48fc-b58b-eaceaa18940c req-e829d0d5-1c24-4bcf-9a46-754fb43d51eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036858 Jul 14 10:59:42.451255 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 194/385] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:42.996880 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:42.997592 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:43.005078 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:43.005603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:43.006576 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:43.007015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:43.177269 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:43.185912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:43.187526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:43.189052 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3dd2bd3b-7e55-4ff4-8722-b69cef5987c6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.196886 Jul 14 10:59:43.190053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 192/386] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:42 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:44.209354 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:44.209959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:44.216670 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:44.217116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:44.217877 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:44.218312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:44.362464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:44.371361 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:44.372899 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:44.374134 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-39d8dbce-37f9-419e-ba1f-50659b8bcc1f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.169449 Jul 14 10:59:44.374758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 195/387] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:44 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:45.392977 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:45.393526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:45.401056 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:45.401497 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:45.402291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:45.402725 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:45.551434 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:45.560273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:45.561793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:45.562985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2709a5d8-7e5c-4e63-9628-ddd1038f7c62 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1809 microversion: 2.20 time: 0.174181 Jul 14 10:59:45.563620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 193/388] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:45 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:46.591291 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:46.592466 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:46.602966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:46.603709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:46.605017 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:46.605872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:46.741768 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:46.750894 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:46.752809 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:59:46.753962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d1cc0d71-f6af-4d9b-bead-9e79783c631b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1796 microversion: 2.20 time: 0.169144 Jul 14 10:59:46.754555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 196/389] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 10:59:46 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1796 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:59:54.416798 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af3393d-7a24-4e61-8f9c-2e19a62bd2a8"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:59:54.417993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:54.425118 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:54.425573 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:54.426343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:54.426766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:54.571387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:59:54.572445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:59:54.585977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:54.588281 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:54.590346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:59:54.590806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:59:54.742352 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fadf9351-395e-4d65-8d17-5fc577c8340b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329386 Jul 14 10:59:54.743183 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 194/390] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 10:59:54 2022] POST /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:59:54.764927 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lazy-loading 'services' on Instance uuid 43f20d4c-65f1-4c7c-b436-c1f4db0b527d {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:59:54.876516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:54.894883 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2a94fd99-e00f-4056-af48-3e5392302847 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-volume_attachments/4d71669b-bd32-4187-866f-3bef1fe9f335" status: 202 len: 0 microversion: 2.1 time: 0.332378 Jul 14 10:59:54.895766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 197/391] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 10:59:54 2022] DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-volume_attachments/4d71669b-bd32-4187-866f-3bef1fe9f335 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:00:02.285860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:02.286868 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:02.293644 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.294094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.294871 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.295310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.318286 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lazy-loading 'flavor' on Instance uuid 8f9aa3e5-a93c-4850-808e-789d7637d049 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:00:02.365504 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-973fe579-87c0-48a3-a811-1522be2b1dfa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:02.371735 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-973fe579-87c0-48a3-a811-1522be2b1dfa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.372219 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-973fe579-87c0-48a3-a811-1522be2b1dfa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.396263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-973fe579-87c0-48a3-a811-1522be2b1dfa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Going to try to stop instance {{(pid=133221) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:00:02.440019 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-973fe579-87c0-48a3-a811-1522be2b1dfa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action" status: 202 len: 0 microversion: 2.1 time: 0.078378 Jul 14 11:00:02.441262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 198/392] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:00:02 2022] POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:00:02.442162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-233c35d0-50ee-45d9-942c-56fca80c0643 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/action" status: 200 len: 32 microversion: 2.1 time: 0.161447 Jul 14 11:00:02.442890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 195/393] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:00:02 2022] POST /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:00:02.454026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:02.454760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:02.459190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:02.459894 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:02.462549 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.463038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.464346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.464970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.466470 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.466954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.467732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:02.468203 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:02.728058 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:02.736530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-79e2c530-8b70-4728-aad9-9ec567bf4f6f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.281803 Jul 14 11:00:02.737179 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 196/394] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:02 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:02.774119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:02.782028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-627995bb-691b-4e78-ad47-cd5c940607c6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.332807 Jul 14 11:00:02.782694 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 199/395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:02 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:03.754092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:03.754800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:03.758402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=28 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:03.762483 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:03.762914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:03.772321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:03.772321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:03.798791 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:03.799401 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:03.805822 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:03.806268 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:03.807070 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:03.807503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:03.952062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:03.960546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b9ffa6df-9bec-4e6e-9233-6664cc160751 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.210521 Jul 14 11:00:03.961131 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 197/396] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:03 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:03.980762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:03.989945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-99dd73c0-6359-49d4-ac14-bdff13592643 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.195228 Jul 14 11:00:03.990519 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 200/397] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:03 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:00:04.977882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:04.978718 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:04.985355 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:04.985808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:04.986795 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:04.987228 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:05.008871 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:05.009688 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:05.015939 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:05.017129 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:05.018058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:05.018514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:05.185254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:05.194800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-00012ead-9e22-4be6-a1f2-77bb9f08d747 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.220713 Jul 14 11:00:05.201744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:04 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:05.202050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:05.207023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-03c05fe3-1ae6-40b5-b429-aab56f304a42 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.202176 Jul 14 11:00:05.207595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 201/399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:05 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:00:06.212849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:06.214169 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:06.221060 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:06.221494 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:06.222335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:06.222767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:06.225453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:06.230556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:06.231201 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:06.237755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:06.238246 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:06.239093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:06.239528 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:06.425955 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:06.436282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b2d6acb0-3425-47a1-9026-074e51e16851 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.227586 Jul 14 11:00:06.446987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 199/400] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:06 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:06.450457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:06.459932 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6b0c2947-5ee8-40ff-b0fa-0148231ffea6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.234621 Jul 14 11:00:06.460505 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 202/401] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:06 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:07.458430 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:07.459333 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:07.469859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:07.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:07.471935 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:07.472627 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:07.481138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:07.482131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:07.491016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:07.491451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:07.492319 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:07.492748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:07.682387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:07.685066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:07.691522 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-23575ff4-ff47-4f42-bed6-d139844327b8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.239844 Jul 14 11:00:07.692294 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 200/402] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:07 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:07.692998 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3cab11c8-9639-4321-b84b-25ee2fa2bf3f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.217720 Jul 14 11:00:07.693635 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 203/403] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:07 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:08.712534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:08.713543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:08.713784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:08.714556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:08.717841 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=28 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:08.724480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:08.724924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:08.725585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:08.725741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:08.726028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:08.726191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:08.726793 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:08.727230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:08.923591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:08.926960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:08.932921 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3477d7cb-d546-403d-bd18-32b41bf08493 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.225816 Jul 14 11:00:08.933707 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 204/404] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:08 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:08.935839 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-306fb1e7-3b26-43a2-978e-9fcfac005075 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.230098 Jul 14 11:00:08.936432 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 201/405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:08 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:09.950575 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:09.951263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:09.954260 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:09.955462 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:09.958234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:09.958683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:09.959445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:09.962514 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:09.962960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:09.963090 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:09.963749 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:09.964221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:10.162211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:10.171208 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-dd626820-d39f-4f98-b400-ab22e329f3a3 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.224568 Jul 14 11:00:10.171779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 205/406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:09 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:10.188175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:10.196911 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3b78ce51-8337-4f02-a547-9da321e913db tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.246796 Jul 14 11:00:10.197485 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 202/407] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:09 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:11.191557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:11.192784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:11.200815 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:11.201190 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:11.202008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:11.202441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:11.214448 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:11.215227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:11.222088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:11.223205 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:11.224034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:11.224491 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:11.684321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:11.688729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:11.692739 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-30d924e6-27a9-4938-93c0-e486e79eb90a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.505134 Jul 14 11:00:11.698865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ce9f8422-eb30-43f9-a255-73ece764cc9f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.488131 Jul 14 11:00:11.699565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 203/408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:11 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:11.701833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 206/409] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:11 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:12.714844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:12.715784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:12.720866 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:12.721866 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:12.726416 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:12.726854 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:12.727629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:12.728099 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:12.729499 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:12.729959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:12.730734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:12.731152 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:12.928232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:12.932317 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:12.936609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-80058b86-ff65-47f8-b003-b45812844afa tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.228749 Jul 14 11:00:12.937431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 204/410] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:12 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:12.947698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-42581dd6-c4d4-4a47-8c67-e22e093a8a47 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.233238 Jul 14 11:00:12.948337 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 207/411] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:12 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:13.955308 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:13.956194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:13.964381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:13.964818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:13.965172 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:13.965631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:13.965782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:13.966002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:13.972675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:13.973125 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:13.973932 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:13.974366 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:14.163685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:14.166237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:14.171739 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6f62fa43-7608-46cc-b00e-1aa028d9838a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.220564 Jul 14 11:00:14.172319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 205/412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:13 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:14.174585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-661d7cf7-eb48-446e-98ee-192c457ff4df tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.213304 Jul 14 11:00:14.175152 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 208/413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:13 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:15.189850 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:15.190555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:15.192291 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:15.192915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:15.197862 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:15.198319 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:15.199093 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:15.199375 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:15.199553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:15.199827 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:15.200618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:15.201046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:15.403185 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:15.406876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:15.415096 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-44c5127c-90df-49ec-8385-a994a3274750 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.226609 Jul 14 11:00:15.415786 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 209/414] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:15 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:15.417940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0c398b43-9ada-431a-8c4f-70400f283a59 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.232032 Jul 14 11:00:15.418749 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 206/415] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:15 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:16.439294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:16.440220 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:16.440881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:16.441062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:16.448595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:16.448973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:16.449093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:16.449429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:16.449872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:16.450205 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:16.450308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:16.450664 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:16.647271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:16.654771 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:16.658369 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8758a6b5-275e-4a8b-9ef7-fa4ffe364e08 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.225917 Jul 14 11:00:16.658990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 210/416] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:16 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:16.662670 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-febec5fd-3c52-4aa1-b18c-bc66f6a93261 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.230053 Jul 14 11:00:16.663291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 207/417] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:16 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:17.678475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:17.679094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:17.681609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:17.682235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:17.686107 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:17.686535 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:17.687302 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:17.687731 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:17.689139 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:17.689583 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:17.690332 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:17.690787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:17.891008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:17.893821 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:17.900305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c7198085-2285-4f61-9bf5-0c49d04348f3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.227311 Jul 14 11:00:17.900991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 211/418] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:17 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:17.902159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7ed7a937-72e2-43c7-b168-a79b2a484c32 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1677 microversion: 2.1 time: 0.225603 Jul 14 11:00:17.902733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 208/419] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:17 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:18.918953 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:18.919524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:18.919913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:18.920009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:18.926591 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:18.926756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:18.927034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:18.927195 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:18.927807 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:18.927967 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:18.928283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:18.928428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:19.127851 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:19.130965 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:19.136549 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c24e3fa0-d141-4bf8-bdba-293dfacce6d0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.221545 Jul 14 11:00:19.137378 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 212/420] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:18 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:19.139318 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-889222de-9d54-43f1-ace1-3562a7b04da8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1654 microversion: 2.1 time: 0.224014 Jul 14 11:00:19.139852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 209/421] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:18 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1654 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:00:19.156328 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9e26ad7f-4c1f-4a20-a172-5d57b53e288c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:19.162452 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9e26ad7f-4c1f-4a20-a172-5d57b53e288c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:19.162934 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9e26ad7f-4c1f-4a20-a172-5d57b53e288c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:19.176481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:19.186297 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9e26ad7f-4c1f-4a20-a172-5d57b53e288c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Going to try to start instance {{(pid=133221) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:00:19.235757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9e26ad7f-4c1f-4a20-a172-5d57b53e288c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action" status: 202 len: 0 microversion: 2.1 time: 0.082982 Jul 14 11:00:19.236382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 213/422] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:00:19 2022] POST /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:00:19.245038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:19.245636 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:19.252077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:19.252814 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:19.253784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:19.254240 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:19.391114 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:19.399533 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-14773fe7-d9e8-411f-8444-7d6a1ee97884 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1663 microversion: 2.1 time: 0.158649 Jul 14 11:00:19.400251 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 210/423] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:19 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:20.154969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:20.155634 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:20.162791 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:20.163239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:20.164316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:20.164757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:20.314316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:20.322541 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d0b6faea-4fbe-40ee-a47f-042db7374bec tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.172047 Jul 14 11:00:20.323126 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 214/424] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:20 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:20.421296 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:20.422285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:20.443771 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:20.444587 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:20.445992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:20.446531 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:20.587720 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:20.595814 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-564b91bc-d704-461e-8100-1e0aafa7a709 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1663 microversion: 2.1 time: 0.180985 Jul 14 11:00:20.596433 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 211/425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:20 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1663 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:21.339692 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:21.340323 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:21.346946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:21.347401 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:21.348200 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:21.348634 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:21.509113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:21.517803 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-172872c5-71e3-4b14-b9c9-5fbb7f25385f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.182439 Jul 14 11:00:21.518353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 215/426] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:21 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:21.613722 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:21.614338 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:21.621032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:21.621480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:21.622252 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:21.622712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:21.762087 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:21.770707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1006ac0e-8e1e-45a8-8f26-a6edc9c58dc8 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1663 microversion: 2.1 time: 0.160944 Jul 14 11:00:21.771306 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 212/427] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:21 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:22.537071 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:22.537658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:22.544166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:22.544625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:22.545419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:22.545857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:22.756431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:22.765684 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ff162cae-8d49-43d7-85f4-3e15055f3a3c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.232605 Jul 14 11:00:22.766264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 216/428] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:22 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:22.788788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:22.789367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:22.796364 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:22.796833 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:22.797624 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:22.798047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:22.992142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:23.000282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-db692e4e-a36a-4660-b7dc-b1c02756a220 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1663 microversion: 2.1 time: 0.215283 Jul 14 11:00:23.001057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 213/429] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:22 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1663 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:23.786766 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:23.787379 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:23.795814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:23.796574 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:23.797831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:23.798543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:23.956522 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:23.965219 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5d6f2566-b714-4963-a2b9-a9aa3eafedf3 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1735 microversion: 2.1 time: 0.182347 Jul 14 11:00:23.965800 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 217/430] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:23 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:24.020885 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:24.021756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:24.032177 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:24.032822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:24.033926 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:24.034548 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:24.181544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:24.190239 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2cfac019-9162-46d1-8d14-8350ef0526cf tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1667 microversion: 2.1 time: 0.174815 Jul 14 11:00:24.191085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 214/431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:24 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:24.982980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:24.983592 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:24.990133 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:24.990590 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:24.991352 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:24.991792 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.135067 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:25.150853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7956a0c7-e393-40ed-ad25-efd035b51c61 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1715 microversion: 2.1 time: 0.171324 Jul 14 11:00:25.151465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 218/432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:24 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:25.259771 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:25.260343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:25.267350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:25.267794 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.268599 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:25.269035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.544917 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=100 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:25.554594 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] HTTP exception thrown: Cannot 'detach_volume' instance 8f9aa3e5-a93c-4850-808e-789d7637d049 while it is in vm_state rescued Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Request method failure captured: Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments/1af3393d-7a24-4e61-8f9c-2e19a62bd2a8 HTTP/1.1 Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZxCzm8p1YviuXJJgYmxPWWWm8xd2NLzFeQZiWjRg4vQN9lBIVLZer67nLhgb3z8M7YSkQ8X0n-Ewm-xM3Lnef0BuA3f6tRGIHdG63v99lMYJ4ep8nb3Fax4qpuhOeyavefDN426pqfnUz6zlZBeQEP6XzBuqDXubUb36fMllsRdHw Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:00:25.556545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2d5301114244be2a74210484c6536ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2d5301114244be2a74210484c6536ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: b47991b6880c4a91ab42d2567eee61aa Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:00:25.558102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Cannot 'detach_volume' instance 8f9aa3e5-a93c-4850-808e-789d7637d049 while it is in vm_state rescued Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'server_id': '8f9aa3e5-a93c-4850-808e-789d7637d049', 'id': '1af3393d-7a24-4e61-8f9c-2e19a62bd2a8'} Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:25.559363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8f9aa3e5-a93c-4850-808e-789d7637d049 while it is in vm_state rescued Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8f9aa3e5-a93c-4850-808e-789d7637d049 while it is in vm_state rescued Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:25.560800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Returning 409 to user: Cannot 'detach_volume' instance 8f9aa3e5-a93c-4850-808e-789d7637d049 while it is in vm_state rescued {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:25.561900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c894552d-5682-48fd-9139-18c1029ddd53 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments/1af3393d-7a24-4e61-8f9c-2e19a62bd2a8" status: 409 len: 152 microversion: 2.1 time: 0.302588 Jul 14 11:00:25.561900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 215/433] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:00:25 2022] DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments/1af3393d-7a24-4e61-8f9c-2e19a62bd2a8 => generated 152 bytes in 304 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:00:25.567080 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:25.567592 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:25.575972 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:25.576465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.577335 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:25.577776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.648469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9f4109a1-51e1-4700-a158-9a675073c873 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "POST /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/action" status: 202 len: 0 microversion: 2.1 time: 0.085087 Jul 14 11:00:25.649465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 219/434] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:00:25 2022] POST /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:00:25.664611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:25.665227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:25.671645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:25.672137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.672910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:25.673346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:25.897592 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:25.912764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c389e14c-00d0-47bc-8427-7dfd9c04e7fe tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1723 microversion: 2.1 time: 0.258000 Jul 14 11:00:25.914416 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 216/435] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:25 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:26.931269 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:26.932315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:26.939035 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:26.939441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:26.940462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:26.940893 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:27.112607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:27.121943 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-26fcc7ee-1174-4d51-8377-e9fc9bfe4083 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1723 microversion: 2.1 time: 0.194750 Jul 14 11:00:27.122764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 220/436] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:26 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:28.143812 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:28.144429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:28.153655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:28.154094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:28.154818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:28.155283 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:28.305662 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:28.314263 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4362cab0-959b-47c3-af48-b8cad95587c5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1723 microversion: 2.1 time: 0.176495 Jul 14 11:00:28.314842 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 217/437] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:28 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:29.334841 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:29.335507 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:29.344382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:29.345077 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:29.346294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:29.346976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:29.489119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:29.497593 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e73621e1-99c9-49e4-a210-a65c88eedb7c tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1729 microversion: 2.1 time: 0.168185 Jul 14 11:00:29.498171 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 221/438] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:29 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:29.514335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:29.514867 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:29.521672 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:29.522124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:29.522901 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:29.523341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:29.610864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-64f23045-f4ca-4f4b-9ac9-7c760abe2eb5 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100446 Jul 14 11:00:29.611469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 218/439] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 11:00:29 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:30.804542 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-ddaa4e77-35ed-4239-a34e-bd15b37e5089 req-1f385318-8b73-4754-b836-93068a5c4d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9aa3e5-a93c-4850-808e-789d7637d049", "tag": "ca5f8bad-44e3-4e53-a1c5-9a328af00a8f"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:30.823702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-ddaa4e77-35ed-4239-a34e-bd15b37e5089 req-1f385318-8b73-4754-b836-93068a5c4d39 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:30.824138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-ddaa4e77-35ed-4239-a34e-bd15b37e5089 req-1f385318-8b73-4754-b836-93068a5c4d39 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:30.838518 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-ddaa4e77-35ed-4239-a34e-bd15b37e5089 req-1f385318-8b73-4754-b836-93068a5c4d39 service nova] Creating event network-changed:ca5f8bad-44e3-4e53-a1c5-9a328af00a8f for instance 8f9aa3e5-a93c-4850-808e-789d7637d049 on hv-cinder-84614 Jul 14 11:00:30.843827 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-ddaa4e77-35ed-4239-a34e-bd15b37e5089 req-1f385318-8b73-4754-b836-93068a5c4d39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043004 Jul 14 11:00:30.844478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 222/440] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:32.861748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-0a552a1d-2d1a-4dc6-9d19-af99d3fc9ef8 req-14e38271-6e3d-4d08-bf4b-48bb0c0cfc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9aa3e5-a93c-4850-808e-789d7637d049", "tag": "ca5f8bad-44e3-4e53-a1c5-9a328af00a8f"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:32.871065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-0a552a1d-2d1a-4dc6-9d19-af99d3fc9ef8 req-14e38271-6e3d-4d08-bf4b-48bb0c0cfc7f service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:32.871513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-0a552a1d-2d1a-4dc6-9d19-af99d3fc9ef8 req-14e38271-6e3d-4d08-bf4b-48bb0c0cfc7f service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:32.883828 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-0a552a1d-2d1a-4dc6-9d19-af99d3fc9ef8 req-14e38271-6e3d-4d08-bf4b-48bb0c0cfc7f service nova] Creating event network-changed:ca5f8bad-44e3-4e53-a1c5-9a328af00a8f for instance 8f9aa3e5-a93c-4850-808e-789d7637d049 on hv-cinder-84614 Jul 14 11:00:32.889483 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-0a552a1d-2d1a-4dc6-9d19-af99d3fc9ef8 req-14e38271-6e3d-4d08-bf4b-48bb0c0cfc7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032022 Jul 14 11:00:32.890240 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 219/441] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:37.516736 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:37.517313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:37.524515 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:37.524895 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:37.525668 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:37.526104 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:37.555769 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bb4d9fa8-ae4e-44b1-afb1-651d8fbc01ba tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments/7b9a79b8-114b-4a97-bd72-0be543ca7313" status: 200 len: 194 microversion: 2.20 time: 0.044246 Jul 14 11:00:37.556489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 223/442] 10.222.0.27 () {60 vars in 1453 bytes} [Thu Jul 14 11:00:37 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments/7b9a79b8-114b-4a97-bd72-0be543ca7313 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:37.624678 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:37.625235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:37.629177 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=46 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:37.636941 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:37.637390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:37.638200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:37.638633 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:37.728863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lazy-loading 'services' on Instance uuid 049f0944-f485-4674-9518-e2b0c244c2c6 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:00:37.853358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9036555d-8367-42a7-8160-59fc0461daea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments/7b9a79b8-114b-4a97-bd72-0be543ca7313" status: 202 len: 0 microversion: 2.20 time: 0.235390 Jul 14 11:00:37.853985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 220/443] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jul 14 11:00:37 2022] DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments/7b9a79b8-114b-4a97-bd72-0be543ca7313 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:00:37.862779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:37.864005 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:37.870382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:37.870942 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:37.872419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:37.872886 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:37.904807 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2c94f673-6c85-4bde-a5b8-4e24924301b9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045962 Jul 14 11:00:37.905441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 224/444] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 11:00:37 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:38.920008 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:38.921065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:38.927920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:38.928405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:38.929172 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:38.929607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:38.962236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0796bc48-fcc4-4d5e-b6f3-8aaee2cde4ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048377 Jul 14 11:00:38.962784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 221/445] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 11:00:38 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:00:39.021362 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:39.021901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:39.025152 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=42 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:39.033663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:39.034389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:39.035553 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:39.036364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:39.064251 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:00:39.150621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-96edec5b-3a02-464f-9082-2fc46e5fe7c5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 204 len: 0 microversion: 2.20 time: 0.132286 Jul 14 11:00:39.151209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 225/446] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 11:00:39 2022] DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:00:39.159800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:39.160453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:39.166480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:39.166922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:39.167671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:39.168301 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:39.301820 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:39.312114 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:39.313631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:39.314800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b8bd980a-e940-49a9-b3a2-5fcaf0b78c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.158885 Jul 14 11:00:39.315353 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 222/447] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:39 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:00:40.338657 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:40.339670 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:40.350049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:40.350796 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:40.352139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:40.352860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:40.508903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:40.517413 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:40.518933 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:40.520167 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e974c97b-1ff8-4f46-aedf-600d2a7b8575 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.188883 Jul 14 11:00:40.520702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 226/448] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:40 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:41.538835 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:41.539443 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:41.546733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:41.547186 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:41.548071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:41.548506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:41.754675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:41.764428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:41.766346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:41.767541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cedb7b43-abdf-4851-9a11-68714e692c49 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 200 len: 1724 microversion: 2.20 time: 0.232787 Jul 14 11:00:41.768131 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 223/449] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:41 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:42.053474 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-3cc74453-86bc-4165-9196-591d0b32d243 req-8817502f-90bd-4ca6-a0f0-86ada69b3ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049f0944-f485-4674-9518-e2b0c244c2c6", "name": "network-vif-deleted", "tag": "185e75bc-ed24-4141-9f73-38940be37817"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:42.064907 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-3cc74453-86bc-4165-9196-591d0b32d243 req-8817502f-90bd-4ca6-a0f0-86ada69b3ef2 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:42.065565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-3cc74453-86bc-4165-9196-591d0b32d243 req-8817502f-90bd-4ca6-a0f0-86ada69b3ef2 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:42.069046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:42.081729 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-3cc74453-86bc-4165-9196-591d0b32d243 req-8817502f-90bd-4ca6-a0f0-86ada69b3ef2 service nova] Creating event network-vif-deleted:185e75bc-ed24-4141-9f73-38940be37817 for instance 049f0944-f485-4674-9518-e2b0c244c2c6 on hv-cinder-84614 Jul 14 11:00:42.088000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-3cc74453-86bc-4165-9196-591d0b32d243 req-8817502f-90bd-4ca6-a0f0-86ada69b3ef2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038391 Jul 14 11:00:42.088605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 227/450] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:42.786526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:42.787187 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:42.795022 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:42.795471 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:42.796296 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:42.796735 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:42.811073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] HTTP exception thrown: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Request method failure captured: Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 HTTP/1.1 Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZwhP3GDdf8Cq5tPajxlriUF86Q5_GA1KEKmXQLKXuairG-3DZTsg5lPdGXuqCEcKkCjcVnu1FXfxpaE3ByqoZpHOSZKxnjLNeAKWLrLOd6iD8Ibd4fx90B817pEWv1o3hKyti-5RyOxzEl17Oy08GXwyk768CeQvWpMRvAMRZI98c Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:00:42.812740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 3e4012911dad42edbffead00e0fd55e6 Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:00:42.814133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '049f0944-f485-4674-9518-e2b0c244c2c6'} Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:00:42.815057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:00:42.816311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:00:42.817398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Returning 404 to user: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:00:42.817398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-67393a52-2d5b-4655-9bc3-33c07f480af2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 404 len: 111 microversion: 2.20 time: 0.031649 Jul 14 11:00:42.820057 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 224/451] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:42 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:00:42.824167 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1d54d664-b844-452c-9c8a-af52765e8dc8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '.version_select at 0x7f13d454e280>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:42.844803 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1d54d664-b844-452c-9c8a-af52765e8dc8 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009447417" status: 204 len: 0 microversion: 2.20 time: 0.025025 Jul 14 11:00:42.845864 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 228/452] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jul 14 11:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009447417 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:00:43.510762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3e2cb98f-62b0-4eab-aba6-aaa9298d0849 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'create', calling method: .version_select at 0x7f13d44205e0>, body: {"keypair": {"name": "tempest-keypair-2113644461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlAtwO9xJgQlUtMMUqsSRkae6s2Cb22Mcd4EYlhH7+iRuKTUBL/A6Kr7s55aKTCaiKICstmSBphSUrd3GsuFM/EW7oBsO9tKhpSHnWebz5qRoLxEEDMW3nhrU8xfEUstA=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:43.525265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3e2cb98f-62b0-4eab-aba6-aaa9298d0849 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for project 2ff1f327753b4708b0940964aa3d761c. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:00:43.529101 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3e2cb98f-62b0-4eab-aba6-aaa9298d0849 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for user 3e4012911dad42edbffead00e0fd55e6 and project 2ff1f327753b4708b0940964aa3d761c. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:00:43.551011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3e2cb98f-62b0-4eab-aba6-aaa9298d0849 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044533 Jul 14 11:00:43.551610 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 225/453] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jul 14 11:00:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 11:00:45.096205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1629654883", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24b72f21-647f-469a-9422-b0123813b1a7"}], "security_groups": [{"name": "tempest-securitygroup--829963623"}], "key_name": "tempest-keypair-2113644461", "user_data": "}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:45.207770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] validate_networks() for [('24b72f21-647f-469a-9422-b0123813b1a7', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:00:45.586168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:00:45.587141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:00:45.587896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:00:45.588309 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:00:45.588795 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:00:45.602670 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:45.603292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:45.604558 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:45.605187 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:45.623719 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for project 2ff1f327753b4708b0940964aa3d761c. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:00:45.628388 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Getting quotas for user 3e4012911dad42edbffead00e0fd55e6 and project 2ff1f327753b4708b0940964aa3d761c. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:00:45.640712 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:00:45.643092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:00:45.698185 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-12b9e8e1-d944-4e26-9dff-d809e67823b6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.606435 Jul 14 11:00:45.699112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 229/454] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jul 14 11:00:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 11:00:45.709767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-bf0a2996-14fb-4874-85f5-50931d7be2ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:45.710387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-bf0a2996-14fb-4874-85f5-50931d7be2ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:45.769291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf0a2996-14fb-4874-85f5-50931d7be2ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:45.777341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf0a2996-14fb-4874-85f5-50931d7be2ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:45.778927 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bf0a2996-14fb-4874-85f5-50931d7be2ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:45.780088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-bf0a2996-14fb-4874-85f5-50931d7be2ad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1282 microversion: 2.20 time: 0.074857 Jul 14 11:00:45.780647 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 226/455] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:45 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:46.798271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:46.798902 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:46.805917 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:46.806367 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:46.807159 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:46.807743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:47.022705 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:47.031538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:47.033084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:47.034185 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b1cb805e-0b24-4468-ad63-55eef8b8083d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1340 microversion: 2.20 time: 0.240294 Jul 14 11:00:47.034749 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 230/456] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:46 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1340 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:48.052822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:48.053456 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:48.061340 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:48.061858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:48.062762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:48.063323 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:48.281980 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:48.291972 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:48.293629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:48.294780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d52b2e2b-862c-4769-a0fc-8f3672d46f2e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.246064 Jul 14 11:00:48.295586 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 227/457] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:48 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:48.513233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-4402ac71-3ad9-40e2-9969-b68e41625925 req-e155dd94-ab6f-424d-b805-f72a2cac14fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:48.527061 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-4402ac71-3ad9-40e2-9969-b68e41625925 req-e155dd94-ab6f-424d-b805-f72a2cac14fd service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:48.528145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-4402ac71-3ad9-40e2-9969-b68e41625925 req-e155dd94-ab6f-424d-b805-f72a2cac14fd service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:48.540315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-4402ac71-3ad9-40e2-9969-b68e41625925 req-e155dd94-ab6f-424d-b805-f72a2cac14fd service nova] Creating event network-changed:88d8238d-6727-48a5-a8a2-dde01ba9cc28 for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c on hv-cinder-84614 Jul 14 11:00:48.545666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-4402ac71-3ad9-40e2-9969-b68e41625925 req-e155dd94-ab6f-424d-b805-f72a2cac14fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042205 Jul 14 11:00:48.546456 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 231/458] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:49.317467 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:49.318325 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:49.327796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:49.328292 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:49.329086 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:49.329512 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:49.479571 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:49.488488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:49.489977 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:49.491068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7ec8fb12-13d3-4d12-b5ef-b797d9d52dff tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.180346 Jul 14 11:00:49.491610 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 228/459] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:49 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:50.516082 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:50.517143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:50.531420 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:50.531926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:50.532697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:50.533134 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:50.671742 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:50.679662 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:50.681173 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:50.682258 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-64c4f766-c3c4-402f-a59a-82a550482ae9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.175027 Jul 14 11:00:50.682813 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 232/460] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:50 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:51.704669 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:51.705752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:51.717488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:51.718236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:51.719504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:51.720304 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:51.861320 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:51.870099 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:51.872264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:51.873126 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0eb9b3e5-d0ad-4fcf-b450-8a891110ad85 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.175302 Jul 14 11:00:51.873696 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 229/461] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:51 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:52.891826 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:52.892430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:52.899225 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:52.900027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:52.900830 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:52.901257 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:53.040569 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:53.048803 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:53.050334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:53.051472 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b90e09b2-3e1c-4c34-87c5-0867eb0a50cc tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.163854 Jul 14 11:00:53.052054 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 233/462] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:52 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:54.077257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:54.077915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:54.085911 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:54.086434 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:54.087320 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:54.087829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:54.230746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:54.242918 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:54.245305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:54.247191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-11aed608-5121-4ccd-a737-662c7fa3b72a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.175839 Jul 14 11:00:54.247957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 230/463] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:54 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:54.592597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-d1542440-29a1-468c-bb48-e5b0da6fde1b req-abf786ab-c93c-4e19-afce-3e1c59c1bb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "name": "network-vif-plugged", "status": "completed", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:54.601587 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-d1542440-29a1-468c-bb48-e5b0da6fde1b req-abf786ab-c93c-4e19-afce-3e1c59c1bb56 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:54.602029 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-d1542440-29a1-468c-bb48-e5b0da6fde1b req-abf786ab-c93c-4e19-afce-3e1c59c1bb56 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:54.614079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-d1542440-29a1-468c-bb48-e5b0da6fde1b req-abf786ab-c93c-4e19-afce-3e1c59c1bb56 service nova] Creating event network-vif-plugged:88d8238d-6727-48a5-a8a2-dde01ba9cc28 for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c on hv-cinder-84614 Jul 14 11:00:54.619286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-d1542440-29a1-468c-bb48-e5b0da6fde1b req-abf786ab-c93c-4e19-afce-3e1c59c1bb56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Jul 14 11:00:54.620135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 234/464] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:55.271220 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:55.271752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:55.279254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:55.279694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:55.280496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:55.280922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:55.432625 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:55.445258 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:55.447631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:55.449531 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-faf25c44-38a2-467d-b211-ae555235a7e6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1407 microversion: 2.20 time: 0.182090 Jul 14 11:00:55.450341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 231/465] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:55 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:56.466478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:56.467258 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=6 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:56.473494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:56.474559 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:56.484622 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:56.485229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:56.486346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:56.486891 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:56.630799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:56.643424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:56.645933 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:56.647696 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-65b04cc7-c03d-448d-a4bf-20e34310b2ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1600 microversion: 2.20 time: 0.182446 Jul 14 11:00:56.648431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 235/466] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:00:56 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:00:56.667377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:56.667907 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:56.669863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:56.676295 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:56.676747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:56.677519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:56.677954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:56.680547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:56.765612 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ae67f6ae-294b-4233-921e-769c5fe773c0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102101 Jul 14 11:00:56.766182 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 232/467] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jul 14 11:00:56 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:00:57.762354 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-eb8d1c21-bc75-4122-b95f-6336fccb0c1c req-b6f6416d-aef5-44bb-b89b-5e06230f5baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:00:57.770484 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-eb8d1c21-bc75-4122-b95f-6336fccb0c1c req-b6f6416d-aef5-44bb-b89b-5e06230f5baf service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:57.770919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-eb8d1c21-bc75-4122-b95f-6336fccb0c1c req-b6f6416d-aef5-44bb-b89b-5e06230f5baf service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:57.782434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-eb8d1c21-bc75-4122-b95f-6336fccb0c1c req-b6f6416d-aef5-44bb-b89b-5e06230f5baf service nova] Creating event network-changed:88d8238d-6727-48a5-a8a2-dde01ba9cc28 for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c on hv-cinder-84614 Jul 14 11:00:57.787571 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-eb8d1c21-bc75-4122-b95f-6336fccb0c1c req-b6f6416d-aef5-44bb-b89b-5e06230f5baf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029336 Jul 14 11:00:57.788248 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 236/468] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:00:59.412278 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:59.413472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:59.420196 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:59.420645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:59.421410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:59.421830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:59.451198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6d169c62-ba51-45d6-bfad-e67ce8df448b tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043461 Jul 14 11:00:59.451753 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 233/469] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:00:59 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:00:59.513345 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:59.513959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:59.520506 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:59.520960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:59.521731 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:59.522169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:59.548176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:00:59.635072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f7522976-f739-46ba-b237-73e3c0adf339 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 204 len: 0 microversion: 2.1 time: 0.125773 Jul 14 11:00:59.635660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 237/470] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:00:59 2022] DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:00:59.644356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:00:59.645039 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:00:59.652707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:59.653148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:59.653991 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:00:59.654405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:00:59.788447 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:00:59.796589 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-db29ea35-6444-479a-88c9-394eb1943634 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1673 microversion: 2.1 time: 0.156312 Jul 14 11:00:59.797154 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 234/471] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:00:59 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:00.815636 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:00.816534 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:00.825087 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:00.825638 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:00.826431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:00.826867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:00.978684 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:00.987056 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-04b0c2c5-9c49-4f3c-8887-cb0b10f0e454 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1673 microversion: 2.1 time: 0.175623 Jul 14 11:01:00.987545 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 238/472] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:00 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:02.004984 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:02.005569 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:02.012107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:02.012561 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:02.013698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:02.014136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:02.226390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:02.235023 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1e3ba875-67b6-4cfc-a5c6-55f51017e12c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 200 len: 1673 microversion: 2.1 time: 0.233987 Jul 14 11:01:02.235578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 235/473] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:01 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:02.631259 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-e7270700-6caa-4a6b-bad3-76a489980c4e req-f2baa829-f8e0-4222-ac5f-7cfadd24c227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f20d4c-65f1-4c7c-b436-c1f4db0b527d", "name": "network-vif-deleted", "tag": "4d1f30e4-cd27-4452-bd74-6ba39a7a6857"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:02.640440 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-e7270700-6caa-4a6b-bad3-76a489980c4e req-f2baa829-f8e0-4222-ac5f-7cfadd24c227 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:02.640882 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-e7270700-6caa-4a6b-bad3-76a489980c4e req-f2baa829-f8e0-4222-ac5f-7cfadd24c227 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:02.657798 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-e7270700-6caa-4a6b-bad3-76a489980c4e req-f2baa829-f8e0-4222-ac5f-7cfadd24c227 service nova] Creating event network-vif-deleted:4d1f30e4-cd27-4452-bd74-6ba39a7a6857 for instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d on hv-cinder-84614 Jul 14 11:01:02.662977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-e7270700-6caa-4a6b-bad3-76a489980c4e req-f2baa829-f8e0-4222-ac5f-7cfadd24c227 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035411 Jul 14 11:01:02.663777 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 239/474] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:03.114156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:03.114748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:03.121444 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:03.122817 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:03.123712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:03.124273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:03.214027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lazy-loading 'services' on Instance uuid 8f9aa3e5-a93c-4850-808e-789d7637d049 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:01:03.253968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:03.254764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:03.262100 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:03.262711 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:03.263620 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:03.264098 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:03.280469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] HTTP exception thrown: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Request method failure captured: Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d HTTP/1.1 Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqcNjuEUVGHSjHTMqWwXHNAkUNOxta8J4YqBirXQM2nEXri23He0sQsJSwxloPpLCyprxRysP2vHn4-vbU-ndC8Lh2jPK8Vyj0w5PGuZ-V5mqvjoEQaj4FQqL1EAz2SE6yH85bLW_DCY5Kk-UqEY38qpzOOw-g82ddAoKl8FL06rs Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:01:03.282101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3160540122441ce970560d7a3db2521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3160540122441ce970560d7a3db2521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 6ead76e4f3564d6eb614bb911ccaf674 Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:01:03.283462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '43f20d4c-65f1-4c7c-b436-c1f4db0b527d'} Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:03.284347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:01:03.285625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:03.287485 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Returning 404 to user: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:03.288371 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1f6b3c38-9789-479c-9fd8-db20bd03a0f9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 404 len: 111 microversion: 2.1 time: 0.039113 Jul 14 11:01:03.288933 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 240/475] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:03 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:01:03.295529 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-822bee88-5e98-431b-bc77-79c7c3ade07f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments/1af3393d-7a24-4e61-8f9c-2e19a62bd2a8" status: 202 len: 0 microversion: 2.1 time: 0.185236 Jul 14 11:01:03.299274 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 236/476] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:01:03 2022] DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments/1af3393d-7a24-4e61-8f9c-2e19a62bd2a8 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:01:03.299428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a6abd1c5-d99b-47d6-8d43-46d4006ebf7d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '.version_select at 0x7f13d454eee0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:03.315807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:03.316924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:03.323397 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a6abd1c5-d99b-47d6-8d43-46d4006ebf7d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775615387" status: 202 len: 0 microversion: 2.1 time: 0.029772 Jul 14 11:01:03.324214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:03.327842 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 241/477] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 11:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775615387 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:01:03.328070 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:03.328070 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:03.328070 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:03.374667 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8f890239-d515-4759-a06d-4b66194ca979 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073827 Jul 14 11:01:03.375689 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 237/478] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:01:03 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:04.021379 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6042e239-b277-4d28-8ab9-5cac3b402b38 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: .version_select at 0x7f13d453b670>, body: {"keypair": {"name": "tempest-keypair-1006666740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFdDRQHXkmnSbQR0arUGTyp8sCUe6LITKI9xcUMTEYoAqucYaWo5By5aVbl4xSpFFsGrpgElUjqZwMU1rKNFOeamlPIpeePuGZdNvtNPfu6VzMGpUCoSPORuQZlXlx/dQ=="}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:04.035714 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-6042e239-b277-4d28-8ab9-5cac3b402b38 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for project a3160540122441ce970560d7a3db2521. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:01:04.040149 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-6042e239-b277-4d28-8ab9-5cac3b402b38 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for user 6ead76e4f3564d6eb614bb911ccaf674 and project a3160540122441ce970560d7a3db2521. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:01:04.064117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6042e239-b277-4d28-8ab9-5cac3b402b38 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046584 Jul 14 11:01:04.064710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 242/479] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:01:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:04.386980 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:04.388717 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:04.395401 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:04.396547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:04.397345 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:04.397788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:04.428562 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e0d8c2a7-cfe6-4c37-a417-1682c3fc85b1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045680 Jul 14 11:01:04.429139 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 238/480] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:01:04 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:01:04.500142 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:04.500707 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:04.507005 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:04.507455 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:04.508313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:04.508753 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:04.535415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:01:04.621298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-862b2095-75e9-4389-b713-542bba1c7cc1 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 204 len: 0 microversion: 2.1 time: 0.125355 Jul 14 11:01:04.622551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 243/481] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:01:04 2022] DELETE /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:01:04.631277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:04.632206 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:04.638894 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:04.639424 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:04.640305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:04.640800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:05.002097 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:05.010048 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-73a98af0-ab8b-447d-a845-5318d28b0f5a tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1689 microversion: 2.1 time: 0.383346 Jul 14 11:01:05.010625 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 239/482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:04 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1689 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:05.737026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-573023598", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6d52b3c-ba6d-4280-906d-b963886d7469"}], "security_groups": [{"name": "tempest-securitygroup--2012782715"}], "key_name": "tempest-keypair-1006666740", "user_data": "}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:05.842302 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] validate_networks() for [('d6d52b3c-ba6d-4280-906d-b963886d7469', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:01:06.027058 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:06.027628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:06.034796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:06.035244 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:06.036067 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:06.036505 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:06.249606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:06.257666 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3e38b593-ae64-4889-8c58-27e17647be83 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1689 microversion: 2.1 time: 0.234919 Jul 14 11:01:06.258225 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 240/483] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:06 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:06.311142 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:01:06.311785 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:01:06.312605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:01:06.313249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:01:06.313893 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:01:06.327444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:06.327903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:06.328821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:06.329258 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:06.350893 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for project a3160540122441ce970560d7a3db2521. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:01:06.355436 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Getting quotas for user 6ead76e4f3564d6eb614bb911ccaf674 and project a3160540122441ce970560d7a3db2521. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:01:06.368171 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:01:06.370556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:01:06.380527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:06.419576 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b1b3238e-56f3-4d3a-8013-e78df94ccfb9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.687634 Jul 14 11:01:06.420260 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 244/484] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:01:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:01:06.430719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9bbfcb1a-9943-406b-97c4-9299b45bc892 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:06.431469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9bbfcb1a-9943-406b-97c4-9299b45bc892 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:06.487340 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9bbfcb1a-9943-406b-97c4-9299b45bc892 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:06.494431 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9bbfcb1a-9943-406b-97c4-9299b45bc892 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1237 microversion: 2.1 time: 0.067635 Jul 14 11:01:06.494995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 241/485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:06 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:07.275043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:07.275971 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:07.283045 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:07.283498 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:07.284318 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:07.284751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:07.425520 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:07.433432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2c0df069-5890-44d6-aaf7-e83da85862a0 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1689 microversion: 2.1 time: 0.162424 Jul 14 11:01:07.433995 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 245/486] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:07 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:07.515191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:07.515739 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:07.523718 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:07.524201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:07.524985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:07.525740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:07.593271 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:07.601249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5d3b1e37-b084-48ae-8a08-cbf6dd72d6e2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1241 microversion: 2.1 time: 0.091345 Jul 14 11:01:07.602026 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 242/487] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:07 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:08.451852 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:08.452564 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:08.458997 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:08.459516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:08.460460 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:08.460955 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:08.618644 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:08.619241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:08.621774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:08.627375 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:08.627826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:08.628638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:08.629076 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:08.757422 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:08.765776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3d27f1fc-1a0f-4a3e-9307-933ac75f93bd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1295 microversion: 2.1 time: 0.151100 Jul 14 11:01:08.766355 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 243/488] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:08 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:08.796002 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:08.803812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8ae41655-47cd-443a-8e1a-02a06f9a1e9d tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1689 microversion: 2.1 time: 0.356415 Jul 14 11:01:08.804511 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 246/489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:08 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1689 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:09.470311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-5184d87a-5197-4ca9-94c7-529431a9588f req-1a0c422d-65ef-4d20-b8a1-cc3452c5b69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9aa3e5-a93c-4850-808e-789d7637d049", "name": "network-vif-deleted", "tag": "ca5f8bad-44e3-4e53-a1c5-9a328af00a8f"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:09.488316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5184d87a-5197-4ca9-94c7-529431a9588f req-1a0c422d-65ef-4d20-b8a1-cc3452c5b69a service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:09.489065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5184d87a-5197-4ca9-94c7-529431a9588f req-1a0c422d-65ef-4d20-b8a1-cc3452c5b69a service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:09.530863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-5184d87a-5197-4ca9-94c7-529431a9588f req-1a0c422d-65ef-4d20-b8a1-cc3452c5b69a service nova] Creating event network-vif-deleted:ca5f8bad-44e3-4e53-a1c5-9a328af00a8f for instance 8f9aa3e5-a93c-4850-808e-789d7637d049 on hv-cinder-84614 Jul 14 11:01:09.547517 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-5184d87a-5197-4ca9-94c7-529431a9588f req-1a0c422d-65ef-4d20-b8a1-cc3452c5b69a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083632 Jul 14 11:01:09.548873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 244/490] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:09.783539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:09.784179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:09.790536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:09.790982 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:09.791748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:09.792341 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:09.821701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:09.822657 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:09.829662 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:09.830194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:09.831254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:09.831764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:09.876221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:09.876677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:09.877136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lazy-loading 'fault' on Instance uuid 8f9aa3e5-a93c-4850-808e-789d7637d049 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:01:09.942146 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:09.951315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4c3c8f35-ec6b-4821-a839-17690662ab86 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 200 len: 1335 microversion: 2.1 time: 0.133888 Jul 14 11:01:09.952750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 245/491] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:09 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:10.087524 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:10.100949 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-cef7bb14-7182-463d-a350-42f1083abc62 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.321951 Jul 14 11:01:10.102058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 247/492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:09 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:10.969867 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:10.970469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 8f9aa3e5-a93c-4850-808e-789d7637d049] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:10.983033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:10.983742 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:10.984865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:10.985284 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:11.005495 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] HTTP exception thrown: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 could not be found. Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Request method failure captured: Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 HTTP/1.1 Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZxCzm8p1YviuXJJgYmxPWWWm8xd2NLzFeQZiWjRg4vQN9lBIVLZer67nLhgb3z8M7YSkQ8X0n-Ewm-xM3Lnef0BuA3f6tRGIHdG63v99lMYJ4ep8nb3Fax4qpuhOeyavefDN426pqfnUz6zlZBeQEP6XzBuqDXubUb36fMllsRdHw Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:01:11.008827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2d5301114244be2a74210484c6536ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2d5301114244be2a74210484c6536ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: b47991b6880c4a91ab42d2567eee61aa Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 could not be found. Jul 14 11:01:11.010330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '8f9aa3e5-a93c-4850-808e-789d7637d049'} Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 could not be found. Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:11.011127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 could not be found. Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 could not be found. Jul 14 11:01:11.013358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:11.015789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Returning 404 to user: Instance 8f9aa3e5-a93c-4850-808e-789d7637d049 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:11.015789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4c1719b1-aae5-4c62-ac58-2e7338a812f6 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049" status: 404 len: 111 microversion: 2.1 time: 0.045085 Jul 14 11:01:11.021859 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2cdf626b-b2d5-4d0d-ac33-4a8b55e27578 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '.version_select at 0x7f13d45db940>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:11.026871 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 246/493] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:10 2022] GET /compute/v2.1/servers/8f9aa3e5-a93c-4850-808e-789d7637d049 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:11.044982 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2cdf626b-b2d5-4d0d-ac33-4a8b55e27578 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443606166" status: 202 len: 0 microversion: 2.1 time: 0.028316 Jul 14 11:01:11.045763 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 248/494] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 11:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443606166 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:01:11.122509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:11.123378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:11.133076 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:11.134160 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:11.135995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:11.137003 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:11.406795 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:11.421843 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-08cf5cf7-842e-4cb3-936d-6d9a7071270a tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.306138 Jul 14 11:01:11.422854 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 247/495] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:11 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:11.587104 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-68e94513-7708-4263-af02-de02ace37192 req-af05e0f5-a896-4355-8efa-2f93eb8a0c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afebadb-23f7-4429-975a-0835aeb84cb7", "tag": "63ea8364-2cb0-4a85-9965-6c21430fed68"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:11.595672 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-68e94513-7708-4263-af02-de02ace37192 req-af05e0f5-a896-4355-8efa-2f93eb8a0c06 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:11.596135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-68e94513-7708-4263-af02-de02ace37192 req-af05e0f5-a896-4355-8efa-2f93eb8a0c06 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:11.607356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-68e94513-7708-4263-af02-de02ace37192 req-af05e0f5-a896-4355-8efa-2f93eb8a0c06 service nova] Creating event network-changed:63ea8364-2cb0-4a85-9965-6c21430fed68 for instance 6afebadb-23f7-4429-975a-0835aeb84cb7 on hv-cinder-84614 Jul 14 11:01:11.612228 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-68e94513-7708-4263-af02-de02ace37192 req-af05e0f5-a896-4355-8efa-2f93eb8a0c06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029204 Jul 14 11:01:11.612799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 249/496] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:12.439493 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:12.440114 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:12.446853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:12.447350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:12.448200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:12.448631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:12.652582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:12.660645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e8bb89c0-79c1-4b14-b98f-2d5c5a883c31 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.225087 Jul 14 11:01:12.661223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 248/497] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:12 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:13.678627 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:13.679347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:13.685999 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:13.686460 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:13.687240 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:13.687664 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:13.690364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:13.837303 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:13.845287 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c8a1ffcb-29ba-4197-bbc2-a1f1757f78c7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.171027 Jul 14 11:01:13.845882 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 250/498] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:13 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:14.015774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:14.016358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:14.023166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:14.023621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:14.024411 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:14.024844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:14.050038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:01:14.073237 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:14.138442 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d7325a51-f0e3-4771-be82-ebe2b1210f10 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 204 len: 0 microversion: 2.1 time: 0.125712 Jul 14 11:01:14.139200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 249/499] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:01:14 2022] DELETE /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:01:14.147864 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:14.148492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:14.155170 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:14.155618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:14.156446 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:14.156945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:14.304380 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:14.312453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c1f3198f-7680-40cb-a84d-aaa2448c4fda tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1507 microversion: 2.1 time: 0.168398 Jul 14 11:01:14.313038 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 251/500] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:14 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:01:14.865295 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:14.866020 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:14.873108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:14.873563 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:14.874327 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:14.874761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:15.006551 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:15.014235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f776b4f4-e930-4900-ac42-11274c279ed2 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.154063 Jul 14 11:01:15.014804 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 250/501] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:14 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:15.333838 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:15.334853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:15.344008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:15.344459 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:15.345229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:15.345669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:15.482130 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:15.493814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-60d78ebc-ccf2-4b36-b5bd-68011d9c247b tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1507 microversion: 2.1 time: 0.166112 Jul 14 11:01:15.494600 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 252/502] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:15 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:16.036341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:16.036894 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:16.044983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:16.045476 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:16.046328 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:16.046822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:16.189507 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:16.197652 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-79e6ec3a-9609-4552-b914-bab81a57f65c tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.165764 Jul 14 11:01:16.198232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 251/503] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:16 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:16.514034 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:16.514734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:16.516688 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:16.517334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=10 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:16.523175 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:16.523634 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:16.524441 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:16.524886 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:16.704555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-fe68fdb5-c803-49c6-934f-eb4a39dd7351 req-76ea109c-a425-4a7b-bad2-74a4f0ea716d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afebadb-23f7-4429-975a-0835aeb84cb7", "name": "network-vif-plugged", "status": "completed", "tag": "63ea8364-2cb0-4a85-9965-6c21430fed68"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:16.712685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:16.722330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-fe68fdb5-c803-49c6-934f-eb4a39dd7351 req-76ea109c-a425-4a7b-bad2-74a4f0ea716d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:16.724556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-fe68fdb5-c803-49c6-934f-eb4a39dd7351 req-76ea109c-a425-4a7b-bad2-74a4f0ea716d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:16.739253 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-fe68fdb5-c803-49c6-934f-eb4a39dd7351 req-76ea109c-a425-4a7b-bad2-74a4f0ea716d service nova] Creating event network-vif-plugged:63ea8364-2cb0-4a85-9965-6c21430fed68 for instance 6afebadb-23f7-4429-975a-0835aeb84cb7 on hv-cinder-84614 Jul 14 11:01:16.743505 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-fe68fdb5-c803-49c6-934f-eb4a39dd7351 req-76ea109c-a425-4a7b-bad2-74a4f0ea716d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047029 Jul 14 11:01:16.744701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 252/504] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:16.756431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:16.800577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-584f4dc7-3c33-4cbf-84cd-a2cf848c6505 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1507 microversion: 2.1 time: 0.290926 Jul 14 11:01:16.801836 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 253/505] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:16 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:16.904382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-c4f05248-df3b-4d84-9d9d-431ec55e1286 req-13fabc30-36fb-41a8-8c83-4fddfe56bec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96", "name": "network-vif-deleted", "tag": "ff4bff3c-060d-4301-8121-466dae5b3f56"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:16.915092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-c4f05248-df3b-4d84-9d9d-431ec55e1286 req-13fabc30-36fb-41a8-8c83-4fddfe56bec7 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:16.915546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-c4f05248-df3b-4d84-9d9d-431ec55e1286 req-13fabc30-36fb-41a8-8c83-4fddfe56bec7 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:16.931110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-c4f05248-df3b-4d84-9d9d-431ec55e1286 req-13fabc30-36fb-41a8-8c83-4fddfe56bec7 service nova] Creating event network-vif-deleted:ff4bff3c-060d-4301-8121-466dae5b3f56 for instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 on hv-cinder-84614 Jul 14 11:01:16.937480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-c4f05248-df3b-4d84-9d9d-431ec55e1286 req-13fabc30-36fb-41a8-8c83-4fddfe56bec7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Jul 14 11:01:16.939919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 253/506] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:17.214870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:17.215476 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:17.222190 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:17.222641 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:17.223434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:17.223947 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:17.363089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:17.370748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-96821312-840b-4e39-91d8-5bee57827754 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1363 microversion: 2.1 time: 0.159832 Jul 14 11:01:17.371308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 254/507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:17 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:17.823670 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:17.824341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:17.831463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:17.832268 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:17.833055 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:17.833488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:17.870298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:17.870736 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:17.871065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lazy-loading 'fault' on Instance uuid cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:01:17.919746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:17.927120 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-48832881-cbbb-4ebb-beb2-16bbc46b5cb8 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 200 len: 1311 microversion: 2.1 time: 0.108583 Jul 14 11:01:17.927678 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 254/508] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:17 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:18.394072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:18.394834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:18.404566 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.405262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.406603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.407255 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.544547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:18.552440 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5096a482-d1f1-4e37-ae5a-da6774aabd65 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1548 microversion: 2.1 time: 0.163904 Jul 14 11:01:18.552997 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 255/509] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:18 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:18.568760 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:18.569289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:18.575620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.576118 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.576883 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.577321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.656794 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4df9e64b-3fff-4cc8-a04b-fdf14e16919d tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091964 Jul 14 11:01:18.657396 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 255/510] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 11:01:18 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:18.944545 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:18.945162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:18.951602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.952094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.952867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.953300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.967527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] HTTP exception thrown: Instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 could not be found. Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Request method failure captured: Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 HTTP/1.1 Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZxCzm8p1YviuXJJgYmxPWWWm8xd2NLzFeQZiWjRg4vQN9lBIVLZer67nLhgb3z8M7YSkQ8X0n-Ewm-xM3Lnef0BuA3f6tRGIHdG63v99lMYJ4ep8nb3Fax4qpuhOeyavefDN426pqfnUz6zlZBeQEP6XzBuqDXubUb36fMllsRdHw Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:01:18.969236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2d5301114244be2a74210484c6536ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2d5301114244be2a74210484c6536ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: b47991b6880c4a91ab42d2567eee61aa Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 could not be found. Jul 14 11:01:18.970645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96'} Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 could not be found. Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:18.971432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 could not be found. Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 could not be found. Jul 14 11:01:18.972722 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:18.973767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Returning 404 to user: Instance cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:18.973767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-72fb4861-cf1c-4b2b-befc-c495e6173e87 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96" status: 404 len: 111 microversion: 2.1 time: 0.030052 Jul 14 11:01:18.973767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 256/511] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:18 2022] GET /compute/v2.1/servers/cd2ac671-3cc3-4f9c-8e1a-9f007cef1c96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:18.980009 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:18.980530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:18.987341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.987791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:18.988598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:18.989027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:19.016809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:01:19.102533 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0c6aeba9-98d3-4a90-b03a-82a2700dcacc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 204 len: 0 microversion: 2.1 time: 0.126624 Jul 14 11:01:19.103292 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 256/512] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:01:18 2022] DELETE /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:01:19.111606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:19.112232 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:19.118344 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:19.118784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:19.119532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:19.119987 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:19.365787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:19.373959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-60ed22fe-b5eb-4a6d-a1b8-e1ce46c69a66 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.266306 Jul 14 11:01:19.374532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 257/513] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:19 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:19.673113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-1d3f5c2c-2cd0-4003-9d6b-db73ac4fae48 req-17e4d4e9-2c94-458f-accc-f5aa6d313397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afebadb-23f7-4429-975a-0835aeb84cb7", "tag": "63ea8364-2cb0-4a85-9965-6c21430fed68"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:19.681599 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1d3f5c2c-2cd0-4003-9d6b-db73ac4fae48 req-17e4d4e9-2c94-458f-accc-f5aa6d313397 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:19.682030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1d3f5c2c-2cd0-4003-9d6b-db73ac4fae48 req-17e4d4e9-2c94-458f-accc-f5aa6d313397 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:19.693493 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-1d3f5c2c-2cd0-4003-9d6b-db73ac4fae48 req-17e4d4e9-2c94-458f-accc-f5aa6d313397 service nova] Creating event network-changed:63ea8364-2cb0-4a85-9965-6c21430fed68 for instance 6afebadb-23f7-4429-975a-0835aeb84cb7 on hv-cinder-84614 Jul 14 11:01:19.698663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-1d3f5c2c-2cd0-4003-9d6b-db73ac4fae48 req-17e4d4e9-2c94-458f-accc-f5aa6d313397 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029623 Jul 14 11:01:19.699257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 257/514] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:20.390847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:20.391466 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:20.398095 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:20.398542 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:20.399308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:20.399734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:20.534099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:20.542568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b73e49bf-6ae5-47c4-a120-c2f7f0af21dc tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.155367 Jul 14 11:01:20.542855 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 258/515] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:20 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:21.564618 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:21.565982 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:21.576542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:21.577279 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:21.578530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:21.579242 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:21.718842 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:21.726945 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-68add7ac-d3b7-4251-a730-327a3e34dd1e tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.170339 Jul 14 11:01:21.727562 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 258/516] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:21 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:22.744883 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:22.745503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:22.752003 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:22.752464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:22.753271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:22.753702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:23.000157 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47991b6880c4a91ab42d2567eee61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d5301114244be2a74210484c6536ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:23.008013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9c6d6773-1ec8-47f5-8435-719c86177f65 tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 200 len: 1522 microversion: 2.1 time: 0.267036 Jul 14 11:01:23.008599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 259/517] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:22 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:23.172951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-caf23581-767c-4734-9a96-d2295678e72d req-5c7c931a-38e5-470b-9cb0-aabba5cabc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866fb74a-bbb5-4346-9080-eb2a117ee2cf", "name": "network-vif-deleted", "tag": "22421220-3077-41b7-8f35-d60e4cd33e0a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:23.182196 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-caf23581-767c-4734-9a96-d2295678e72d req-5c7c931a-38e5-470b-9cb0-aabba5cabc03 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:23.182628 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-caf23581-767c-4734-9a96-d2295678e72d req-5c7c931a-38e5-470b-9cb0-aabba5cabc03 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:23.199191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-caf23581-767c-4734-9a96-d2295678e72d req-5c7c931a-38e5-470b-9cb0-aabba5cabc03 service nova] Creating event network-vif-deleted:22421220-3077-41b7-8f35-d60e4cd33e0a for instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf on hv-cinder-84614 Jul 14 11:01:23.206001 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-caf23581-767c-4734-9a96-d2295678e72d req-5c7c931a-38e5-470b-9cb0-aabba5cabc03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Jul 14 11:01:23.206608 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 259/518] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:24.025577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:24.026469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] [instance: 866fb74a-bbb5-4346-9080-eb2a117ee2cf] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:24.032961 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:24.033432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:24.034176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:24.034715 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:24.048334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] HTTP exception thrown: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf could not be found. Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Request method failure captured: Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf HTTP/1.1 Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZxCzm8p1YviuXJJgYmxPWWWm8xd2NLzFeQZiWjRg4vQN9lBIVLZer67nLhgb3z8M7YSkQ8X0n-Ewm-xM3Lnef0BuA3f6tRGIHdG63v99lMYJ4ep8nb3Fax4qpuhOeyavefDN426pqfnUz6zlZBeQEP6XzBuqDXubUb36fMllsRdHw Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:01:24.050089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2d5301114244be2a74210484c6536ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2d5301114244be2a74210484c6536ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2d5301114244be2a74210484c6536ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: c2d5301114244be2a74210484c6536ef Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132282364 Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: b47991b6880c4a91ab42d2567eee61aa Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132282364-project Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf could not be found. Jul 14 11:01:24.051567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '866fb74a-bbb5-4346-9080-eb2a117ee2cf'} Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf could not be found. Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:24.052376 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf could not be found. Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf could not be found. Jul 14 11:01:24.053536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:24.054614 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] Returning 404 to user: Instance 866fb74a-bbb5-4346-9080-eb2a117ee2cf could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:24.054614 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-24bed9e4-db1e-4a61-92dd-6d9ea718221f tempest-ServerRescueNegativeTestJSON-2132282364 tempest-ServerRescueNegativeTestJSON-2132282364-project] 10.222.0.27 "GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf" status: 404 len: 111 microversion: 2.1 time: 0.029845 Jul 14 11:01:24.054614 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 260/519] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:24 2022] GET /compute/v2.1/servers/866fb74a-bbb5-4346-9080-eb2a117ee2cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:28.634601 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4d5ba9f6-4d12-448d-ae74-e46e51f2ad98 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Action: 'create', calling method: .version_select at 0x7f13d44c6790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1662271963"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:28.942080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4d5ba9f6-4d12-448d-ae74-e46e51f2ad98 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.441393 Jul 14 11:01:28.942712 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 260/520] 10.222.0.27 () {60 vars in 1154 bytes} [Thu Jul 14 11:01:28 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 443 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 14 11:01:28.953887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bc0d5cf0-bc95-401c-8869-9f4a3ffd0138 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d453b670>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:29.002621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bc0d5cf0-bc95-401c-8869-9f4a3ffd0138 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 200 len: 345 microversion: 2.1 time: 0.052627 Jul 14 11:01:29.003181 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 261/521] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:01:28 2022] GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:01:30.019286 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d84e89ed-a72f-4b76-9395-826637db88b1 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d43c2a60>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:30.068853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d84e89ed-a72f-4b76-9395-826637db88b1 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 200 len: 346 microversion: 2.1 time: 0.056611 Jul 14 11:01:30.069424 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 261/522] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:01:30 2022] GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:30.080663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2b005313-7a70-45b5-9419-158381cee3a4 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Action: 'create', calling method: .version_select at 0x7f13d46f6a60>, body: {"snapshot": {"volume_id": "9da9fea5-c667-48d0-ae32-9ca6f931280d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1244185870"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:30.237739 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2b005313-7a70-45b5-9419-158381cee3a4 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.160977 Jul 14 11:01:30.238516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 262/523] 10.222.0.27 () {60 vars in 1161 bytes} [Thu Jul 14 11:01:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:30.248555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-794da57f-eeab-4cbe-8b97-1e504f9d00ee tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d43815e0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:30.279790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-794da57f-eeab-4cbe-8b97-1e504f9d00ee tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 200 len: 287 microversion: 2.1 time: 0.035245 Jul 14 11:01:30.280504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 262/524] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:30 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:01:30.291046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4f50ec22-f4fb-46f1-9515-e869efbcd8d9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d454ed30>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:30.320611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4f50ec22-f4fb-46f1-9515-e869efbcd8d9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033780 Jul 14 11:01:30.321414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 263/525] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jul 14 11:01:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:01:30.336495 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-81578612-4b6d-45f8-b55c-549313dafc81 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d43c28b0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:30.369792 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-81578612-4b6d-45f8-b55c-549313dafc81 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 200 len: 287 microversion: 2.1 time: 0.039157 Jul 14 11:01:30.370379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 263/526] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:30 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:31.385850 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f5b6c6b6-24a2-40a2-a1c0-dac6bac40865 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d44ae1f0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:31.422182 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f5b6c6b6-24a2-40a2-a1c0-dac6bac40865 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 200 len: 287 microversion: 2.1 time: 0.042367 Jul 14 11:01:31.422908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 264/527] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:31 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:32.435208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9c206b11-1d24-4113-a850-86b6f20d7fe9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d43a0700>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:32.472449 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9c206b11-1d24-4113-a850-86b6f20d7fe9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 200 len: 287 microversion: 2.1 time: 0.041612 Jul 14 11:01:32.473023 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 264/528] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:32 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:33.489115 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-03739a31-1f3b-4a27-b06d-37f3d634b4ef tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d4431af0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:33.624264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:33.625644 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:33.630293 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:33.630881 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:33.631111 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-03739a31-1f3b-4a27-b06d-37f3d634b4ef tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 200 len: 288 microversion: 2.1 time: 0.147291 Jul 14 11:01:33.631840 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 265/529] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:33 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 288 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:33.640140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:33.640584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:33.641352 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:33.641783 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:33.642149 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-51b3566f-2003-4420-a3b9-bed9db882ad6 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d453bc10>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:33.669602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3183adf2-c8a2-4155-8937-5ffd1d0abfa5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/ips" status: 200 len: 152 microversion: 2.20 time: 0.046144 Jul 14 11:01:33.670173 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 265/530] 10.222.0.27 () {60 vars in 1288 bytes} [Thu Jul 14 11:01:33 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:01:33.706597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-51b3566f-2003-4420-a3b9-bed9db882ad6 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 202 len: 0 microversion: 2.1 time: 0.067697 Jul 14 11:01:33.707291 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 266/531] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jul 14 11:01:33 2022] DELETE /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:01:33.716403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6dbd482e-90f9-445f-af34-f0b9f47685d6 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d44adf70>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:33.747382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6dbd482e-90f9-445f-af34-f0b9f47685d6 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 200 len: 287 microversion: 2.1 time: 0.035583 Jul 14 11:01:33.751748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 266/532] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:33 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:34.758016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:34.759223 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=57 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:34.765873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-17a816c9-5caa-4495-86bf-989924f6bcb9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d4530ca0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:34.799091 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-17a816c9-5caa-4495-86bf-989924f6bcb9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] HTTP exception thrown: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-17a816c9-5caa-4495-86bf-989924f6bcb9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Request method failure captured: Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 HTTP/1.1 Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_eIAKEKzPg4S8HV8mBEspGGcFhbf8EJQPgY4c7xMJLzlfOs5xtylcn_hAnHD2cfqai02A1_EzvpVgNR5y-3zNXl5H8eswrWGRQA9E_C93P1eEVnKzAxyXCIgFbn_v_kKNfLSH1fMcZHZhBVoQlbiCb44Fkok2WvMHPHSU4icDPQSFQ Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:01:34.806008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: bd2a363ad57045ed978ba3592281a5d7 Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'c77abf1e-d646-4117-9c55-5457d46ec571'} Jul 14 11:01:34.807565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. (HTTP 404) (Request-ID: req-857034b8-3fcf-42cb-b0bc-d1833019e5ae) Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.808543 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:01:34.809774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 11:01:34.811176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-17a816c9-5caa-4495-86bf-989924f6bcb9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Returning 404 to user: Snapshot c77abf1e-d646-4117-9c55-5457d46ec571 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:34.812599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-17a816c9-5caa-4495-86bf-989924f6bcb9 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571" status: 404 len: 111 microversion: 2.1 time: 0.050766 Jul 14 11:01:34.813625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 267/533] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 11:01:34 2022] GET /compute/v2.1/os-snapshots/c77abf1e-d646-4117-9c55-5457d46ec571 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:34.817109 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1d4d1f54-1205-4b24-a225-d0e1c9c5101c tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d43d81f0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:34.940244 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1d4d1f54-1205-4b24-a225-d0e1c9c5101c tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 202 len: 0 microversion: 2.1 time: 0.127168 Jul 14 11:01:34.941034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 267/534] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:01:34 2022] DELETE /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:01:34.949357 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9eea5540-073b-4ed1-945b-5ad9effdba93 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d48930d0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:34.999990 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9eea5540-073b-4ed1-945b-5ad9effdba93 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 200 len: 345 microversion: 2.1 time: 0.054407 Jul 14 11:01:35.000557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 268/535] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:01:34 2022] GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:35.631313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:35.631909 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:35.641340 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:35.641808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:35.643035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:35.643511 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:35.666040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lazy-loading 'flavor' on Instance uuid df900805-d79f-4c36-b6b8-8aef7ecd5c6c {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:01:35.936846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d925b3c3-fcec-41b6-bf1a-e76be3706312 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/action" status: 202 len: 0 microversion: 2.20 time: 0.310207 Jul 14 11:01:35.937513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 268/536] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 11:01:35 2022] POST /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:01:35.946502 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:35.947266 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:35.954138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:35.954867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:35.956025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:35.956501 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:36.013349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-aff68bf6-1f1c-4917-8270-f85c09109474 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d46a7af0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:36.041463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-aff68bf6-1f1c-4917-8270-f85c09109474 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] HTTP exception thrown: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-aff68bf6-1f1c-4917-8270-f85c09109474 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Request method failure captured: Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d HTTP/1.1 Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_eIAKEKzPg4S8HV8mBEspGGcFhbf8EJQPgY4c7xMJLzlfOs5xtylcn_hAnHD2cfqai02A1_EzvpVgNR5y-3zNXl5H8eswrWGRQA9E_C93P1eEVnKzAxyXCIgFbn_v_kKNfLSH1fMcZHZhBVoQlbiCb44Fkok2WvMHPHSU4icDPQSFQ Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:01:36.043550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: bd2a363ad57045ed978ba3592281a5d7 Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '9da9fea5-c667-48d0-ae32-9ca6f931280d'} Jul 14 11:01:36.044899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. (HTTP 404) (Request-ID: req-f70ae2a9-e0eb-4be2-b253-9147ce9f4651) Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.045714 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:01:36.046808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:01:36.047898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-aff68bf6-1f1c-4917-8270-f85c09109474 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Returning 404 to user: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:36.049155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-aff68bf6-1f1c-4917-8270-f85c09109474 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 404 len: 109 microversion: 2.1 time: 0.036155 Jul 14 11:01:36.053803 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 269/537] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:01:36 2022] GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:01:36.059585 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e798c3db-3645-4882-b78d-61c20a3e86bc tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d43a0310>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:36.089230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-e798c3db-3645-4882-b78d-61c20a3e86bc tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] HTTP exception thrown: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e798c3db-3645-4882-b78d-61c20a3e86bc tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Request method failure captured: Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d HTTP/1.1 Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_eIAKEKzPg4S8HV8mBEspGGcFhbf8EJQPgY4c7xMJLzlfOs5xtylcn_hAnHD2cfqai02A1_EzvpVgNR5y-3zNXl5H8eswrWGRQA9E_C93P1eEVnKzAxyXCIgFbn_v_kKNfLSH1fMcZHZhBVoQlbiCb44Fkok2WvMHPHSU4icDPQSFQ Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:01:36.091232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: bd2a363ad57045ed978ba3592281a5d7 Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '9da9fea5-c667-48d0-ae32-9ca6f931280d'} Jul 14 11:01:36.092699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. (HTTP 404) (Request-ID: req-b537805a-dd4b-4dc9-8bf5-6f3239453cd5) Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.093541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:01:36.094650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:01:36.096685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e798c3db-3645-4882-b78d-61c20a3e86bc tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Returning 404 to user: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e798c3db-3645-4882-b78d-61c20a3e86bc tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 404 len: 109 microversion: 2.1 time: 0.037367 Jul 14 11:01:36.097730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 270/538] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:01:36 2022] DELETE /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:36.098576 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:36.101315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-dc9a6c6e-1b0c-4ee3-a261-e87c1a245fc0 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Calling method '.version_select at 0x7f13d4495550>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:36.104573 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:36.106076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:36.107628 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d424199e-5c71-48bc-a0b8-ace26398a90b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.165438 Jul 14 11:01:36.108220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 269/539] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:35 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:36.128002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-dc9a6c6e-1b0c-4ee3-a261-e87c1a245fc0 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] HTTP exception thrown: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-dc9a6c6e-1b0c-4ee3-a261-e87c1a245fc0 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Request method failure captured: Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d HTTP/1.1 Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_eIAKEKzPg4S8HV8mBEspGGcFhbf8EJQPgY4c7xMJLzlfOs5xtylcn_hAnHD2cfqai02A1_EzvpVgNR5y-3zNXl5H8eswrWGRQA9E_C93P1eEVnKzAxyXCIgFbn_v_kKNfLSH1fMcZHZhBVoQlbiCb44Fkok2WvMHPHSU4icDPQSFQ Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:01:36.130071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4226e0702fef42dc9b88fb02e9b3c76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 4226e0702fef42dc9b88fb02e9b3c76a Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1384362995 Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: bd2a363ad57045ed978ba3592281a5d7 Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1384362995-project Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '9da9fea5-c667-48d0-ae32-9ca6f931280d'} Jul 14 11:01:36.131635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. (HTTP 404) (Request-ID: req-72b9dabe-0bd7-41c9-8870-c9e80c955799) Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.132570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:01:36.133902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:01:36.135212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-dc9a6c6e-1b0c-4ee3-a261-e87c1a245fc0 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] Returning 404 to user: Volume 9da9fea5-c667-48d0-ae32-9ca6f931280d could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-dc9a6c6e-1b0c-4ee3-a261-e87c1a245fc0 tempest-VolumesSnapshotsTestJSON-1384362995 tempest-VolumesSnapshotsTestJSON-1384362995-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d" status: 404 len: 109 microversion: 2.1 time: 0.033914 Jul 14 11:01:36.136638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 271/540] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:01:36 2022] GET /compute/v2.1/os-volumes/9da9fea5-c667-48d0-ae32-9ca6f931280d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:37.126554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:37.127241 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:37.133475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:37.133919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:37.134777 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:37.135220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:37.274555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:37.283391 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:37.285057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:37.286202 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-83475ad7-3a77-45f0-9114-4cfe5801e6d9 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.163857 Jul 14 11:01:37.286915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 270/541] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:37 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:38.306814 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:38.307835 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:38.314953 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:38.315403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:38.316415 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:38.316843 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:38.470500 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:38.479003 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:38.480645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:38.481840 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9535029b-8a28-4c16-a4d1-a7aacc95c540 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.181070 Jul 14 11:01:38.482402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 272/542] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:38 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:39.500681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:39.501289 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:39.507831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:39.508310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:39.509054 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:39.509481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:39.654093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:39.662721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:39.664252 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:39.665402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a3b27c1c-8039-4376-bbeb-e8232ff74ac5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.168630 Jul 14 11:01:39.665958 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 271/543] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:39 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:40.683703 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:40.684364 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:40.691921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:40.692127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:40.692929 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:40.693369 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:40.830760 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:40.840152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:40.841734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:40.842978 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b9c798fa-8599-4563-8584-5a55e8aa11d4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.163332 Jul 14 11:01:40.843603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 273/544] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:40 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:41.865969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:41.866727 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:41.874684 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:41.875240 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:41.876238 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:41.876789 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:42.020055 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:42.028750 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:42.030260 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:42.031444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0a2b82f7-db59-4073-b691-da0910055bea tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.171804 Jul 14 11:01:42.032071 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 272/545] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:41 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:43.054106 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:43.055169 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:43.065651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:43.066095 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:43.066865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:43.067299 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:43.207071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:43.215114 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:43.216661 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:43.217816 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-98b6d503-2d38-45c0-ac11-d79fe25686cf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.170403 Jul 14 11:01:43.218380 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 274/546] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:43 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:44.241244 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:44.242057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:44.252622 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:44.253940 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:44.255214 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:44.255956 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:44.396538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:44.409673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:44.411159 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:44.412326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e51992d3-0b46-440e-a362-463bb58f521e tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.178562 Jul 14 11:01:44.412874 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 273/547] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:44 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:45.435299 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:45.436216 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:45.447113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:45.447862 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:45.449168 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:45.449891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:45.587904 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:45.596365 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:45.597921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:45.599083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-55a3dc1e-f878-4cef-8da0-656873a46e70 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.170525 Jul 14 11:01:45.599667 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 275/548] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:45 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:46.622404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:46.623292 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:46.631192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:46.631863 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:46.633088 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:46.633916 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:46.773908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:46.782572 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:46.784436 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:46.785658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e71e8285-db1a-492e-9ae4-251b2f4c5b4f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.167744 Jul 14 11:01:46.786220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 274/549] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:46 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:47.804094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:47.805272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:47.812165 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:47.812611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:47.813334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:47.813962 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:47.962349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:47.970915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:47.972465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:47.973636 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3d58aa45-1c53-408e-bef8-fe689ee6b238 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.173437 Jul 14 11:01:47.974186 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 276/550] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:47 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:48.909019 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:01:48.909704 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Thu Jul 14 11:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:01:48.993339 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:48.993959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:49.000787 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:49.001227 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:49.001988 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:49.002541 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:49.144409 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:49.152887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:49.154407 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:49.155565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f10068d3-a020-4b64-a91a-d276110cf136 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.166274 Jul 14 11:01:49.156218 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 275/551] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:48 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:50.364832 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:50.366769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:50.373734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:50.374184 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:50.374960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:50.375403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:50.512480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:50.520733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:50.522424 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:50.523746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-21e8914b-ae33-4f98-9e5c-abfbee061773 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.351489 Jul 14 11:01:50.524497 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 277/552] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:50 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:51.546942 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:51.547927 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:51.555394 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:51.555818 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:51.556621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:51.557055 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:51.691079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:51.699078 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:51.700611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:51.701746 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-37faa9d8-18af-464d-a284-21ba8143d9d2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1745 microversion: 2.20 time: 0.161231 Jul 14 11:01:51.702280 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 276/553] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:51 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:52.721606 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:52.722419 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:52.729364 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:52.729818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:52.730596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:52.731034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:52.865767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:52.874012 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:52.875508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:52.876728 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1bc4be7d-1c6a-4735-9e71-75ce74add458 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1745 microversion: 2.20 time: 0.159262 Jul 14 11:01:52.877309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 278/554] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:52 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:53.894668 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:53.895763 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:53.902821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:53.903995 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:53.904858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:53.905382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:54.067456 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:54.077296 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:54.078848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:54.080063 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-45447409-7370-4416-9d03-317cb7cf58ae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.189447 Jul 14 11:01:54.080618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 277/555] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:53 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:54.880586 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-c543da5c-f3c8-4569-9abf-7ab5ffdbb25e req-0dfc548b-0acd-44a2-a917-e8d374736122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "name": "network-vif-plugged", "status": "completed", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:54.898920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-c543da5c-f3c8-4569-9abf-7ab5ffdbb25e req-0dfc548b-0acd-44a2-a917-e8d374736122 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:54.909421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-c543da5c-f3c8-4569-9abf-7ab5ffdbb25e req-0dfc548b-0acd-44a2-a917-e8d374736122 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:54.930780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-c543da5c-f3c8-4569-9abf-7ab5ffdbb25e req-0dfc548b-0acd-44a2-a917-e8d374736122 service nova] Creating event network-vif-plugged:88d8238d-6727-48a5-a8a2-dde01ba9cc28 for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c on hv-cinder-84614 Jul 14 11:01:54.940890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-c543da5c-f3c8-4569-9abf-7ab5ffdbb25e req-0dfc548b-0acd-44a2-a917-e8d374736122 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067480 Jul 14 11:01:54.952691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 279/556] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:55.100683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:55.101299 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:55.107346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:55.107801 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:55.108622 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:55.109058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:55.323061 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:55.331608 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:55.333369 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:55.335049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e7300844-c275-4e24-91bb-9636d380ebfb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.240302 Jul 14 11:01:55.336131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 278/557] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:55 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:55.681410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:55.683475 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:55.692141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:55.692340 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:55.692974 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:55.693405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:55.720235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lazy-loading 'flavor' on Instance uuid fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:01:55.824620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-99dec85e-b6ff-4417-926f-86dd6c1553a8 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "POST /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15/action" status: 202 len: 0 microversion: 2.1 time: 0.147404 Jul 14 11:01:55.826378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 280/558] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:01:55 2022] POST /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:01:55.837264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:55.839092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:55.850512 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:55.851259 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:55.852367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:55.852917 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:56.007508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:56.016301 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-100f566a-d41f-4fea-adbc-7128908d019b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.185264 Jul 14 11:01:56.017858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 281/559] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:55 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:56.043190 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:56.043694 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:56.050165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:56.050665 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:56.051538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:56.051928 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:56.081483 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c83c0de1-6917-4806-88ee-89ccb610bf58 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/ips" status: 200 len: 144 microversion: 2.1 time: 0.354503 Jul 14 11:01:56.082316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 279/560] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:01:55 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/ips => generated 144 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:01:56.354021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:56.354642 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:56.361220 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:56.361922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:56.362882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:56.363836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:56.547552 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:56.558088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:56.559639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:56.561036 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-51376dcc-01bb-430d-accb-8d4ad3065aaf tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.211029 Jul 14 11:01:56.572650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 282/561] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:56 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:57.034784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:57.036279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:57.042878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:57.043330 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:57.044138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:57.044807 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:57.210956 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:57.221003 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-69921ffd-ba6f-4ab5-989f-698fdb2e3784 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.189770 Jul 14 11:01:57.222262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 280/562] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:57 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:01:57.581821 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:57.582525 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:57.589262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:57.589709 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:57.590611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:57.591044 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:57.608808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8279f89e-23ac-4ca6-934a-7aeff2176c31"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:01:57.609961 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:57.611912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:57.617562 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:57.618091 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:57.619515 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:57.619515 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:57.778041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:57.794649 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:57.799038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:57.805152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6c6ac52a-a880-4eda-a569-6c1c5083dfad tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.223749 Jul 14 11:01:57.805896 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 283/563] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:57 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:57.923779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-65605978-78ce-4d5f-863c-170a1da423a6 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318648 Jul 14 11:01:57.929577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 281/564] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:01:57 2022] POST /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:01:58.241771 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:58.242700 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:58.249506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:58.250198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:58.251148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:58.251598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:58.460818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:58.469454 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e8c290c0-8923-462b-9dc3-74a0d2bfb5c7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.234072 Jul 14 11:01:58.470049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 284/565] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:58 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:01:58.825290 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:58.825991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:58.835551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:58.836377 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:58.837465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:58.838153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:59.011248 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:59.022084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:59.025759 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:59.027142 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b1530a65-5324-4e99-b0fd-63a8eeff691a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.207043 Jul 14 11:01:59.030480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 282/566] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:01:58 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:01:59.486747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:01:59.487474 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:01:59.498064 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:59.498989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:59.499791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:01:59.511788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:01:59.673730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:01:59.682303 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-68a92ab8-bad9-4d19-b971-8a0444f9dd22 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.199474 Jul 14 11:01:59.683265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 285/567] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:01:59 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:00.046129 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:00.046853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:00.054669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:00.055230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:00.056158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:00.056702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:00.203492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:00.213027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:00.214880 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:00.216418 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ada8535f-ef5e-4422-99f7-cf8aa8b27066 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.174602 Jul 14 11:02:00.216995 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 283/568] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:00 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:00.700267 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:00.700971 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:00.708612 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:00.709071 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:00.709877 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:00.710349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:00.872812 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:00.883249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-20a988a4-ae7e-4fe5-8fd8-132e82222812 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.186882 Jul 14 11:02:00.895908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 286/569] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:00 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:01.236887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:01.237598 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:01.245411 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:01.245939 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:01.246818 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:01.247252 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:01.269696 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:01.395598 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:01.404873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:01.406368 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:01.407529 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7a0867ea-8779-4771-a1b7-8bcaacf90755 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.174758 Jul 14 11:02:01.419906 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 284/570] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:01 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:01.902889 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:01.903514 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:01.910885 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:01.911329 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:01.917241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:01.917963 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:02.125733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:02.138960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e9d66bf9-d6ec-43d4-9490-7bedb85443a5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.240094 Jul 14 11:02:02.139788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 287/571] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:01 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:02.425942 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:02.426741 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:02.433744 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:02.434192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:02.435013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:02.435628 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:02.607018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:02.616988 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:02.618975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:02.620296 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b522414d-3a79-4b26-af58-70e768f8a5c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.198294 Jul 14 11:02:02.621550 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 285/572] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:02 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:03.167390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:03.167965 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:03.176928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:03.177746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:03.178916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:03.179461 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:03.343859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:03.352853 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-dcd57805-86d5-49ae-880c-a717ebca903e tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.189753 Jul 14 11:02:03.365080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 288/573] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:03 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:03.641508 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:03.643507 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:03.655265 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:03.655805 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:03.656639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:03.657271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:03.792848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:03.805226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:03.807387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:03.810873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bdeed862-309d-4de2-ade7-587f9b1a52a5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1740 microversion: 2.20 time: 0.175600 Jul 14 11:02:03.822007 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 286/574] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:03 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:04.371916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:04.372539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:04.380495 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=39 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:04.383666 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:04.384776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:04.385664 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:04.386639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:04.548660 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:04.557884 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3210bb68-810f-4cb7-a81c-d3eeafb77358 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.189842 Jul 14 11:02:04.558508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 289/575] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:04 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:04.832610 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:04.833239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:04.835612 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=37 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:04.842061 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:04.842437 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:04.843213 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:04.843860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.091934 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:05.102198 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:05.103602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:05.104785 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4fd83ae0-138f-4bd3-89b5-d76bfa043302 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1722 microversion: 2.20 time: 0.276908 Jul 14 11:02:05.116068 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 287/576] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:04 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:05.559993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:05.560989 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:05.567844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:05.568356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.569159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:05.569570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.583760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:05.584416 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:05.590677 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:05.591222 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.592032 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:05.592646 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.603555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7e9bd2b7-b82e-4740-9175-038edc32b5de tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047605 Jul 14 11:02:05.608886 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 290/577] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:02:05 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:05.614007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:05.614504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:05.621066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:05.621557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.622374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:05.622962 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:05.653487 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1e69e84e-58dc-44b1-b32a-46254fee9569 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/8279f89e-23ac-4ca6-934a-7aeff2176c31" status: 200 len: 194 microversion: 2.1 time: 0.042928 Jul 14 11:02:05.654195 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 291/578] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jul 14 11:02:05 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/8279f89e-23ac-4ca6-934a-7aeff2176c31 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:02:05.744523 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:05.752532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-78572c7f-5735-4ec8-9b56-79ac05cd1c35 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.172853 Jul 14 11:02:05.762827 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 288/579] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:05 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:06.124891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:06.125503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:06.132286 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:06.132731 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:06.133490 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:06.133917 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:06.271710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:06.280565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:06.282088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:06.283240 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-42bf0d92-be90-40bc-9ba6-be3788d84d13 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1722 microversion: 2.20 time: 0.162754 Jul 14 11:02:06.283844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 292/580] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:06 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:06.770473 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:06.771119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:06.777758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:06.778521 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:06.779300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:06.779734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:06.985414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:06.995682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-53689e4c-a090-49ea-86b7-ee61968dc393 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.229347 Jul 14 11:02:06.997132 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 289/581] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:06 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:07.045462 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3763c31e-ebcd-4402-a939-883f08ef2305"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:07.046566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:07.053311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:07.053761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:07.054539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:07.054993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:07.302582 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:07.303387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:07.309598 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:07.310035 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:07.310811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:07.311247 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:07.446857 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f3aacb11-91f9-4e31-80fe-8606ef0d8272 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "POST /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405267 Jul 14 11:02:07.447649 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 293/582] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:02:07 2022] POST /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:07.540099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:07.548597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:07.550333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:07.551793 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0e786c61-1112-4408-a657-32b441c55a84 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1725 microversion: 2.20 time: 0.253331 Jul 14 11:02:07.563516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 290/583] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:07 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:07.571680 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0355d35f-410d-4a31-83f1-dfe24d0f5ab4"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:07.572956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:07.581545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:07.582622 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:07.583486 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:07.583827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:07.934737 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-db176888-833e-4967-8e1a-ecf33e19d326 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.367879 Jul 14 11:02:07.936075 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 294/584] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jul 14 11:02:07 2022] POST /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-volume_attachments => generated 188 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:02:08.014217 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:08.014894 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:08.021906 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.022348 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.023128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.023538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.061745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:08.062971 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:08.080828 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.081418 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.082285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.083216 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.183996 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:08.184294 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:08.193263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5fbf6c2d-5f98-4edf-8f52-c45636bc2a2d tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.182823 Jul 14 11:02:08.193830 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 291/585] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:08 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:08.343176 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1fa02343-9959-469c-9016-5a24082010bb tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-volume_attachments/0355d35f-410d-4a31-83f1-dfe24d0f5ab4" status: 202 len: 0 microversion: 2.20 time: 0.285439 Jul 14 11:02:08.343934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 295/586] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jul 14 11:02:08 2022] DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-volume_attachments/0355d35f-410d-4a31-83f1-dfe24d0f5ab4 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:08.399954 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:08.400619 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:08.407487 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.408096 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.408943 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.409486 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.487560 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d7577ae8-d19a-4360-8e38-c44eac42df06 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "POST /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/action" status: 202 len: 0 microversion: 2.20 time: 0.091571 Jul 14 11:02:08.488567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 292/587] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 11:02:08 2022] POST /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:02:08.496887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:08.497298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:08.505335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.505335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.506980 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.507612 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.741543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:08.759748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:08.769021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:08.770776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-280efb36-ebf5-490f-b015-63698ef3fbb0 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1673 microversion: 2.20 time: 0.277780 Jul 14 11:02:08.771722 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 296/588] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:08 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1673 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:08.879534 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-65ec6e40-2d8a-42de-86e1-b2ae3afa6a60 req-1935dd04-7a18-4612-a268-bf3ece7e2a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "name": "network-vif-unplugged", "status": "completed", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:08.899271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-65ec6e40-2d8a-42de-86e1-b2ae3afa6a60 req-1935dd04-7a18-4612-a268-bf3ece7e2a86 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:08.899775 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-65ec6e40-2d8a-42de-86e1-b2ae3afa6a60 req-1935dd04-7a18-4612-a268-bf3ece7e2a86 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:08.926395 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.compute.server_external_events [req-65ec6e40-2d8a-42de-86e1-b2ae3afa6a60 req-1935dd04-7a18-4612-a268-bf3ece7e2a86 service nova] Unable to find a host for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c. Dropping event network-vif-unplugged {{(pid=133221) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 11:02:08.927387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-65ec6e40-2d8a-42de-86e1-b2ae3afa6a60 req-1935dd04-7a18-4612-a268-bf3ece7e2a86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053339 Jul 14 11:02:08.928086 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 293/589] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 11:02:09.212757 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:09.214913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:09.222502 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:09.222953 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:09.224417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:09.225137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:09.454396 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:09.463901 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-19fe8bf3-0a4c-46e4-8a44-a48540170719 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.256666 Jul 14 11:02:09.464674 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 297/590] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:09 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:09.790059 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:09.790681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:09.797190 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:09.797713 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:09.798532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:09.799286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:09.968680 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:09.977414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:09.978922 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:09.980428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0977ca72-cf32-4a87-949e-555248b0373a tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1673 microversion: 2.20 time: 0.194781 Jul 14 11:02:09.980976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 294/591] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:09 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:10.481881 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:10.482565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:10.489646 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:10.490335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:10.491756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:10.492227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:10.731938 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:10.740138 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0a6c4658-00a1-4419-b974-bca988f6b2c3 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1509 microversion: 2.1 time: 0.262172 Jul 14 11:02:10.740705 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 298/592] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:10 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:10.757179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:10.757770 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:10.766760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:10.767224 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:10.768229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:10.768819 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:10.850031 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-343f0fe3-ca01-4103-b32d-283f03740538 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "POST /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15/action" status: 202 len: 0 microversion: 2.1 time: 0.096809 Jul 14 11:02:10.851295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 295/593] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:02:10 2022] POST /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:02:10.861241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:10.862174 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:10.871506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:10.872570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:10.873607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:10.874238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:11.010098 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:11.010758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:11.020567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:11.021181 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:11.022215 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:11.022734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:11.244995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:11.246872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:11.255822 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:11.256502 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5f0cf3fd-b9da-4d58-9b0a-40fa4e15c1da tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1517 microversion: 2.1 time: 0.400776 Jul 14 11:02:11.257121 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 299/594] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:10 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1517 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:11.258168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:11.259384 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-752aa6d9-f912-4d46-92c2-d5db068fe8c4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.264249 Jul 14 11:02:11.260347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 296/595] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:10 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:12.280710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:12.281438 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:12.281438 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:12.282691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:12.288762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:12.289208 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:12.290024 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:12.290461 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:12.291108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:12.291860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:12.293201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:12.293961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:12.524156 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:12.535304 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:12.537833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:12.541916 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:12.543718 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f917b770-aa62-488d-92b8-f862c235d60f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.267529 Jul 14 11:02:12.544511 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 297/596] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:12 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:12.554908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-741a02db-1a29-4fa8-9049-e1aeef093e58 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.270203 Jul 14 11:02:12.554908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 300/597] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:12 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:12.867679 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-6c689d02-6d19-4987-807e-c282d131c5dc req-7131a372-3c1a-4b41-9698-7481e5402750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "name": "network-vif-unplugged", "status": "completed", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:12.884050 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-6c689d02-6d19-4987-807e-c282d131c5dc req-7131a372-3c1a-4b41-9698-7481e5402750 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:12.884803 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-6c689d02-6d19-4987-807e-c282d131c5dc req-7131a372-3c1a-4b41-9698-7481e5402750 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:12.900231 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.compute.server_external_events [req-6c689d02-6d19-4987-807e-c282d131c5dc req-7131a372-3c1a-4b41-9698-7481e5402750 service nova] Unable to find a host for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15. Dropping event network-vif-unplugged {{(pid=133220) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 11:02:12.901395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-6c689d02-6d19-4987-807e-c282d131c5dc req-7131a372-3c1a-4b41-9698-7481e5402750 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041614 Jul 14 11:02:12.902890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 301/598] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 11:02:13.563360 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:13.565098 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:13.565241 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:13.565726 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:13.573854 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:13.574894 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:13.575352 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:13.575808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:13.575991 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:13.576835 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:13.581639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:13.582124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:13.788391 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:13.796469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-64b36521-8005-4751-afa1-c6b4ff43f11b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.236183 Jul 14 11:02:13.797083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 302/599] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:13 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:02:13.819504 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:13.831074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:13.832649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:13.833833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ceade59f-0f4e-4e7a-95b7-ec776ed2e35d tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.274997 Jul 14 11:02:13.834383 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 298/600] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:13 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:02:14.813879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:14.814486 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:14.821344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:14.821765 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:14.822556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:14.822964 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:14.853084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:14.853749 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:14.859986 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:14.860480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:14.861493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:14.861941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:15.085513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:15.095752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a8ffbabe-4849-4222-b2ae-64bec845290f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.285696 Jul 14 11:02:15.096687 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 303/601] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:14 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:15.110178 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:15.115029 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:15.124473 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:15.126242 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:15.127749 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e40a5933-66d7-4a6b-8941-884b7dfc4926 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.279380 Jul 14 11:02:15.142470 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 299/602] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:14 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:16.118362 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:16.118986 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:16.125768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:16.126217 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:16.127027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:16.127463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:16.148167 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:16.149418 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:16.158729 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:16.159613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:16.160841 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:16.162304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:16.329112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:16.339255 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-05a56656-333f-47fc-984a-83a0a75d2d6f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.229250 Jul 14 11:02:16.343347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 304/603] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:16 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:16.378618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:16.388843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:16.390602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:16.391951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5c30a373-624e-4533-a713-407760f3fded tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.248977 Jul 14 11:02:16.392825 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 300/604] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:16 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:17.360726 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:17.361372 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:17.368305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:17.368757 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:17.369592 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:17.370028 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:17.415501 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:17.416930 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:17.425577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:17.426498 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:17.427552 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:17.428259 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:17.598825 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:17.610099 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3e3a617c-d90a-4159-82a5-255bf767343c tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.253352 Jul 14 11:02:17.621158 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 305/605] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:17 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:17.640506 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:17.650355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:17.651903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:17.653095 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a55b7a30-2257-4151-a101-4c5f92db0f69 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.244022 Jul 14 11:02:17.654170 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 301/606] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:17 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:02:18.628542 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:18.629486 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:18.636828 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:18.637235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:18.638195 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:18.638768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:18.672270 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:18.673040 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:18.680877 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:18.681321 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:18.682098 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:18.682530 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:18.864097 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:18.877322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-851e375f-f0b0-4ace-9538-081fd21ed1a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.252914 Jul 14 11:02:18.889402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 306/607] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:18 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:18.922518 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:18.939661 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:18.941997 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:18.946832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e7f72891-2ddd-4cbf-aa7e-95fa25970f29 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.278452 Jul 14 11:02:18.948074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 302/608] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:18 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:02:19.909860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:19.910467 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:19.917488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:19.917945 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:19.918717 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:19.919139 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:19.966421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:19.967094 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:19.973834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:19.974710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:19.975494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:19.975922 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:20.101982 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:20.110381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0b9c8ac8-abcb-43e2-94d7-0382a8cf8ccd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.205777 Jul 14 11:02:20.110932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 307/609] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:19 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:20.159845 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:20.168976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:20.170612 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:20.172151 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7013e374-d7e3-48b5-a6f4-fd8dcb8fde7b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.209556 Jul 14 11:02:20.172872 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 303/610] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:19 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:21.132607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:21.133228 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:21.140966 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:21.141458 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:21.142374 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:21.142849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:21.190605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:21.191186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:21.198082 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:21.198527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:21.199287 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:21.199710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:21.320052 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:21.327846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4f1919e0-b6cd-401c-9f46-19b36bf44e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.201485 Jul 14 11:02:21.328740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 308/611] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:21 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:21.363517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:21.372848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:21.374459 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:21.375784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0fac84fb-9a11-44ac-9b1f-d46658f69ec7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.189120 Jul 14 11:02:21.376710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 304/612] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:21 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:22.346570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:22.347117 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:22.353688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:22.354129 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:22.354896 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:22.355321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:22.394744 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:22.395387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:22.405295 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:22.405740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:22.406513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:22.406968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:22.856025 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:22.859224 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:22.864303 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-05de83ab-4f23-4660-b033-673820f9ded5 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1519 microversion: 2.1 time: 0.521881 Jul 14 11:02:22.864823 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 309/613] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:22 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1519 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:22.870925 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:22.871903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:22.877470 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:22.878162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:22.878607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:22.879289 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:22.879428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:22.879801 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:22.880744 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8d6eaa6d-66fa-43fe-89fb-97787fa20cae tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.490354 Jul 14 11:02:22.899073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 305/614] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:22 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:02:22.914324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-59ff5165-5604-47cf-b60f-f68b53588608 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048282 Jul 14 11:02:22.914915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 310/615] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:02:22 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:23.062811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:23.063307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:23.069693 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.070117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.070858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.071308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.103156 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2fe61f7c-fdc5-4644-8b9f-e0d311fd29ea tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/8279f89e-23ac-4ca6-934a-7aeff2176c31" status: 200 len: 194 microversion: 2.1 time: 0.044243 Jul 14 11:02:23.108562 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 306/616] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jul 14 11:02:23 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/8279f89e-23ac-4ca6-934a-7aeff2176c31 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:23.114111 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:23.114669 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:23.120929 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.121381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.122162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.122604 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.126509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:23.206800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lazy-loading 'services' on Instance uuid 6afebadb-23f7-4429-975a-0835aeb84cb7 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:02:23.283130 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-973d317c-d54e-422e-8986-fa6ddc6bf412 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/8279f89e-23ac-4ca6-934a-7aeff2176c31" status: 202 len: 0 microversion: 2.1 time: 0.172817 Jul 14 11:02:23.284235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 311/617] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:02:23 2022] DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/8279f89e-23ac-4ca6-934a-7aeff2176c31 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:02:23.885706 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:23.886643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:23.898541 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.899078 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.899897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.900388 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.902187 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:23.902819 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:23.909760 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.910207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:23.910981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:23.911417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:24.097074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:24.105285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0e1a59eb-b10b-47e6-b6a7-815beed16a5a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.226112 Jul 14 11:02:24.105867 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 307/618] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:23 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:24.120090 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:24.132128 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:24.133755 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:24.134910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b9c54c30-264c-46d6-b5fc-efd7816e8522 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.238756 Jul 14 11:02:24.135473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 312/619] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:23 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:25.079762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-f443603f-38c4-43fb-999c-e34b909e121e req-720f3676-0ad8-4336-ae07-72089f338177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "name": "network-vif-plugged", "status": "completed", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:25.088171 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-f443603f-38c4-43fb-999c-e34b909e121e req-720f3676-0ad8-4336-ae07-72089f338177 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.088606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-f443603f-38c4-43fb-999c-e34b909e121e req-720f3676-0ad8-4336-ae07-72089f338177 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.100092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-f443603f-38c4-43fb-999c-e34b909e121e req-720f3676-0ad8-4336-ae07-72089f338177 service nova] Creating event network-vif-plugged:88d8238d-6727-48a5-a8a2-dde01ba9cc28 for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c on hv-cinder-84614 Jul 14 11:02:25.105939 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-f443603f-38c4-43fb-999c-e34b909e121e req-720f3676-0ad8-4336-ae07-72089f338177 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153516 Jul 14 11:02:25.106754 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 308/620] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:25.122724 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:25.123284 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:25.131701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.132174 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.132984 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.133388 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.153140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:25.154220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:25.161096 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.161560 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.162704 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.162833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.387937 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:25.396013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-697b76ac-92e2-416f-be1e-4b46e2a37a3b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.277141 Jul 14 11:02:25.396580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 313/621] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:25 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:25.404316 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:25.412698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:25.414249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:25.415428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ca093d19-725c-4e81-b5ad-9368c9227284 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.266610 Jul 14 11:02:25.416011 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 309/622] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:25 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:25.480204 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:25.480702 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:25.486917 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.487370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.488161 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.488596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.517800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fefe688b-5dcf-47d0-9970-ad3038238f02 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/3763c31e-ebcd-4402-a939-883f08ef2305" status: 200 len: 194 microversion: 2.1 time: 0.042212 Jul 14 11:02:25.518379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 314/623] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jul 14 11:02:25 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/3763c31e-ebcd-4402-a939-883f08ef2305 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:25.534261 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:25.534848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:25.542613 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.543057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.543825 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:25.544300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:25.624589 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lazy-loading 'services' on Instance uuid 6afebadb-23f7-4429-975a-0835aeb84cb7 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:02:25.702164 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3c2124f6-f786-4138-92b5-c622687ba981 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/3763c31e-ebcd-4402-a939-883f08ef2305" status: 202 len: 0 microversion: 2.1 time: 0.174495 Jul 14 11:02:25.702765 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 310/624] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:02:25 2022] DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments/3763c31e-ebcd-4402-a939-883f08ef2305 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:02:26.414600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:26.415279 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:26.421966 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:26.422408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:26.423166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:26.423596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:26.434609 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:26.435300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:26.441941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:26.442380 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:26.443138 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:26.443566 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:26.621035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:26.628961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3c831181-42c5-4c94-b730-d6c6d77f3fde tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.218676 Jul 14 11:02:26.629667 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 315/625] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:26 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:26.633690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:26.641920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:26.643635 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:26.644799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ab6f94c5-44c4-4ee3-ae4e-dabf5562bd23 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.214967 Jul 14 11:02:26.645337 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 311/626] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:26 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:27.649616 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:27.650212 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:27.657459 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:27.657897 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:27.658658 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:27.659089 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:27.665601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:27.666213 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:27.673149 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:27.673606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:27.674366 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:27.674795 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:27.860074 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:27.871326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:27.874617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d55e05ab-f990-4f53-93cf-86c01e0a1c27 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.230367 Jul 14 11:02:27.875322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 316/627] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:27 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:27.879633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:27.881154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:27.882291 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c41d5e9d-0fcf-4e84-a36b-799f1f847574 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.220693 Jul 14 11:02:27.882941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 312/628] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:27 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:28.897200 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:28.898283 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:28.902373 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:28.903306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:28.907062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:28.907464 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:28.908532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:28.908995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:28.917962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:28.918657 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:28.919721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:28.920387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:29.119941 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:29.127423 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:29.128009 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-895b7545-95a7-41fd-a867-5a905990b4bb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.237685 Jul 14 11:02:29.128566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 317/629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:28 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:29.135797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:29.137300 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:29.138444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ef6884e2-e8cb-4a3a-aee5-a7d301ca7cd6 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.241530 Jul 14 11:02:29.138984 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 313/630] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:28 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:30.146820 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:30.147519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:30.156413 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:30.156945 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:30.157842 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:30.158353 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:30.158629 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:30.159331 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:30.166909 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:30.167353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:30.168291 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:30.168696 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:30.358638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:30.362857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:30.368310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cb2ce805-a04b-46c4-9ed1-e441f1f7566a tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.226135 Jul 14 11:02:30.368880 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 318/631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:30 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:30.372702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:30.374280 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:30.375525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-069ad999-416a-4b60-b58b-5e4599cf8c53 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.222025 Jul 14 11:02:30.376213 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 314/632] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:30 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:31.389741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:31.390802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:31.398585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:31.399265 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:31.400324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:31.400777 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:31.401531 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:31.401946 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:31.406447 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:31.406901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:31.407674 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:31.408150 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:31.602930 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:31.607235 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:31.613351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8d03f88a-9280-4d14-bc7e-8ffa6e7e7621 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.230148 Jul 14 11:02:31.613929 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 319/633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:31 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:31.617332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:31.619662 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:31.621457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1f06e6a9-2723-46de-94d2-8480fd161ef4 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.229336 Jul 14 11:02:31.622140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 315/634] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:31 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:32.639943 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:32.641024 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:32.648275 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:32.648870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:32.650619 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:32.651086 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:32.651902 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:32.652461 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:32.655966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:32.656445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:32.657213 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:32.657643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:32.676037 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:32.855701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:32.859098 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:32.863601 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-75755ca4-c139-4618-a180-ec4dc44de683 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.231266 Jul 14 11:02:32.864218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 320/635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:32 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:32.867726 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:32.869279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:32.870428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-83266b7b-74eb-4ec5-979a-4dc5f0d39cd5 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.229247 Jul 14 11:02:32.870944 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 316/636] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:32 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:33.885790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:33.886809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:33.892503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:33.893818 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:33.898011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:33.899002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:33.900332 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:33.900769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:33.902173 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:33.902619 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:33.903469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:33.903812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:34.100063 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:34.104191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:34.108377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2c20564d-418b-4cfa-8e61-463f32786d3f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.229632 Jul 14 11:02:34.108961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 321/637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:33 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:34.112821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:34.114355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:34.115510 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-64d34537-8be2-4876-9f6c-48c2435cfe98 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.229398 Jul 14 11:02:34.116124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 317/638] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:33 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:35.125957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:35.126557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:35.129307 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=66 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:35.133810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:35.134424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:35.136149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:35.136605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:35.136773 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=66 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:35.137435 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:35.137849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:35.142016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:35.142554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:35.143320 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:35.143755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:35.337730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:35.340794 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:35.346448 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:35.347985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:35.348611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-796f3d18-31e6-45a2-abee-43acbcf81fad tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.226735 Jul 14 11:02:35.349137 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-af575d5d-628c-46f3-b329-10acdf291076 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.219370 Jul 14 11:02:35.349292 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 322/639] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:35 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:35.349659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 318/640] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:35 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:36.366773 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:36.367445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:36.368793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:36.369452 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:36.374582 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:36.375013 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:36.376032 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:36.376450 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:36.376584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:36.376907 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:36.377694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:36.378123 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:36.585816 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:36.590231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:36.594546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:36.596163 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:36.597326 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-689559af-a0b7-45ce-9dea-9ce8b2e2b6c3 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.234422 Jul 14 11:02:36.597867 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 323/641] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:36 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:36.598421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-18227f43-7417-4ba7-86b7-c1c980d382a0 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.235457 Jul 14 11:02:36.598980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 319/642] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:36 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:37.618608 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:37.619153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:37.619499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:37.619578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:37.626201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:37.626360 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:37.626651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:37.626794 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:37.627422 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:37.627573 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:37.627860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:37.628033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:37.824279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:37.829048 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:37.832592 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0a78f6af-d2c7-4b02-80ab-574c398efccf tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.219488 Jul 14 11:02:37.833272 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 320/643] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:37 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:37.837657 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:37.839330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:37.840391 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a2b1561e-539a-4768-8cc7-8655d165343f tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.228141 Jul 14 11:02:37.841112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 324/644] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:37 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:38.853504 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:38.853939 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:38.860717 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:38.861328 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:38.862080 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:38.862842 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:38.866079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:38.866079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:38.880677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:38.881627 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:38.883018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:38.884453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:39.088347 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:39.096446 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1c6270c4-f534-4c21-a40c-657a3411861b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.249194 Jul 14 11:02:39.097021 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 321/645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:38 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:39.103137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:39.112136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:39.113823 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:39.115403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2e9bd39f-a286-4fb3-83b9-1d3051d9cc99 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1731 microversion: 2.20 time: 0.258558 Jul 14 11:02:39.116077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 325/646] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:38 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:40.114010 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:40.114659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:40.124400 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:40.124977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:40.126047 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:40.126554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:40.133871 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:40.134700 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:40.142255 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:40.142812 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:40.143919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:40.144602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:40.344930 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:40.348960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:40.353168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0cedb4b0-f340-4a1d-afa2-b64a9fb98377 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.243162 Jul 14 11:02:40.353773 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 322/647] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:40 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:40.357465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:40.358978 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:40.360149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1a095551-48ed-4bb6-b94c-ef2119674d64 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1718 microversion: 2.20 time: 0.230324 Jul 14 11:02:40.360704 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 326/648] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:02:40 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1718 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:02:41.371042 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:41.371669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:41.378239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:41.378711 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:41.379471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:41.379983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:41.523767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:41.532811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8df43067-a164-48ee-9659-4584b1bbe8e9 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.165815 Jul 14 11:02:41.533978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 323/649] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:41 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:41.754061 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:41.755065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:41.762315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:41.762757 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:41.763519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:41.763970 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:41.766665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:41.795612 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5540d2b2-ebd9-4921-9267-4dc2c22f12d7 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045438 Jul 14 11:02:41.796530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 327/650] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:02:41 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:02:41.908144 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:41.909165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:41.916245 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:41.916689 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:41.917493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:41.917877 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:41.954737 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b8f6b226-578a-4835-ba14-a3c91daab61f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050840 Jul 14 11:02:41.955222 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 324/651] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:02:41 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:02:42.014354 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:42.014869 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:42.021080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:42.021526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:42.022285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:42.022711 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:42.047806 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:02:42.131727 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ad9e9459-bc2e-49bc-a52f-503556bcc305 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 204 len: 0 microversion: 2.1 time: 0.121003 Jul 14 11:02:42.132370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 328/652] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:02:42 2022] DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:02:42.141151 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:42.141785 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:42.147970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:42.148442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:42.149378 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:42.149897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:42.288344 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:42.295993 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-cd5e2a1f-968f-4256-841e-989b68f5704f tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1672 microversion: 2.1 time: 0.158765 Jul 14 11:02:42.296565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 325/653] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:42 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:42.551027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:42.551675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:42.558860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:42.559349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:42.560150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:42.560611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:42.703509 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:42.715801 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ed5873f0-a9fb-46cc-83e2-271f3ba44da7 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.169066 Jul 14 11:02:42.716677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 329/654] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:42 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:43.090653 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-47c834c2-759c-4d6b-a454-939912251a67 req-ed35f454-3b6c-4bf6-9705-bddc12a87202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "name": "network-vif-plugged", "status": "completed", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:43.103267 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-47c834c2-759c-4d6b-a454-939912251a67 req-ed35f454-3b6c-4bf6-9705-bddc12a87202 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:43.103671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-47c834c2-759c-4d6b-a454-939912251a67 req-ed35f454-3b6c-4bf6-9705-bddc12a87202 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:43.115780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-47c834c2-759c-4d6b-a454-939912251a67 req-ed35f454-3b6c-4bf6-9705-bddc12a87202 service nova] Creating event network-vif-plugged:52a6868d-1e75-44e8-b0bb-7af3b70e050a for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 on hv-cinder-84614 Jul 14 11:02:43.120994 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-47c834c2-759c-4d6b-a454-939912251a67 req-ed35f454-3b6c-4bf6-9705-bddc12a87202 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034350 Jul 14 11:02:43.121596 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 326/655] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:43.316541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:43.317522 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:43.325596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:43.326035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:43.326801 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:43.327229 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:43.472952 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:43.480787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e571e187-1b1a-4f03-8083-4bf9446acd36 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1672 microversion: 2.1 time: 0.170414 Jul 14 11:02:43.481361 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 330/656] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:43 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:43.742009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:43.742832 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:43.749262 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:43.749660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:43.750606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:43.751110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:43.966555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:43.974705 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-fb7cd55c-1749-45a5-9a82-02e007785545 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.238782 Jul 14 11:02:43.975311 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 327/657] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:43 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:44.497893 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:44.498480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:44.505535 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:44.505988 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:44.506752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:44.507182 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:44.601234 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:44.609490 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e5fe01c3-db1f-4bd4-848f-2b6a301ba4d0 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1604 microversion: 2.1 time: 0.115568 Jul 14 11:02:44.610310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 331/658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:44 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:44.993640 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:44.994358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:45.014659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:45.020645 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:45.021720 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:45.022541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:45.029139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-c6182823-926e-4cce-8443-583a4869b353 req-5f516b4c-9c7e-4c11-ac8d-3697ef81c410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afebadb-23f7-4429-975a-0835aeb84cb7", "name": "network-vif-deleted", "tag": "63ea8364-2cb0-4a85-9965-6c21430fed68"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:45.056279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-c6182823-926e-4cce-8443-583a4869b353 req-5f516b4c-9c7e-4c11-ac8d-3697ef81c410 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:45.057108 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-c6182823-926e-4cce-8443-583a4869b353 req-5f516b4c-9c7e-4c11-ac8d-3697ef81c410 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:45.087345 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-c6182823-926e-4cce-8443-583a4869b353 req-5f516b4c-9c7e-4c11-ac8d-3697ef81c410 service nova] Creating event network-vif-deleted:63ea8364-2cb0-4a85-9965-6c21430fed68 for instance 6afebadb-23f7-4429-975a-0835aeb84cb7 on hv-cinder-84614 Jul 14 11:02:45.094683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-c6182823-926e-4cce-8443-583a4869b353 req-5f516b4c-9c7e-4c11-ac8d-3697ef81c410 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254188 Jul 14 11:02:45.096633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 328/659] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:45.197465 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:45.207312 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-98634ab7-d235-4d0c-8e41-dd890f52e14b tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1575 microversion: 2.1 time: 0.218025 Jul 14 11:02:45.208463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 332/660] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:44 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:45.629999 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:45.629999 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:45.636184 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:45.636835 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:45.637621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:45.638249 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:45.680229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:45.681043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:45.682439 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lazy-loading 'fault' on Instance uuid 6afebadb-23f7-4429-975a-0835aeb84cb7 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:02:45.730088 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ead76e4f3564d6eb614bb911ccaf674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3160540122441ce970560d7a3db2521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:45.739209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6d9514e8-ce7f-4cb9-ada6-93c5adab43d9 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 200 len: 1327 microversion: 2.1 time: 0.115726 Jul 14 11:02:45.740405 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 329/661] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:45 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:46.225097 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:46.225713 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:46.233167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:46.233607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:46.234380 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:46.234817 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:46.373787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:46.381717 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-313cfec4-e9f6-4ee7-94d8-2f397d8c71dd tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1562 microversion: 2.1 time: 0.160559 Jul 14 11:02:46.382245 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 333/662] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:46 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:46.757302 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:46.757909 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:46.764640 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:46.765090 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:46.765880 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:46.766416 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:46.781581 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] HTTP exception thrown: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Request method failure captured: Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 HTTP/1.1 Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqcNjuEUVGHSjHTMqWwXHNAkUNOxta8J4YqBirXQM2nEXri23He0sQsJSwxloPpLCyprxRysP2vHn4-vbU-ndC8Lh2jPK8Vyj0w5PGuZ-V5mqvjoEQaj4FQqL1EAz2SE6yH85bLW_DCY5Kk-UqEY38qpzOOw-g82ddAoKl8FL06rs Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:02:46.783457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3160540122441ce970560d7a3db2521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3160540122441ce970560d7a3db2521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 6ead76e4f3564d6eb614bb911ccaf674 Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:46.785072 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '6afebadb-23f7-4429-975a-0835aeb84cb7'} Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:02:46.786239 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:46.787517 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:46.789075 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Returning 404 to user: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:02:46.789075 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-386863bb-cab7-426d-948c-de1cf04a5b03 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 404 len: 111 microversion: 2.1 time: 0.031662 Jul 14 11:02:46.789075 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 330/663] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:46 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:46.801889 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-639f2648-53a8-45d2-88c2-b0a999d5871e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '.version_select at 0x7f13d4328e50>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:46.822207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-639f2648-53a8-45d2-88c2-b0a999d5871e tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006666740" status: 202 len: 0 microversion: 2.1 time: 0.024615 Jul 14 11:02:46.822995 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 334/664] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 11:02:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006666740 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:02:48.621468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-689761596", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "networks": [{"uuid": "98246864-f075-444e-af36-f06c7ce7baa5"}]}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:48.685318 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] validate_networks() for [('98246864-f075-444e-af36-f06c7ce7baa5', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:02:49.120167 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:02:49.120595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:02:49.121073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:02:49.121483 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:02:49.121915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:02:49.131315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:49.131895 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:49.132767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:49.133313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:49.151119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Getting quotas for project ad57e412dc1e46c39f1121f3e4ca8ee9. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:02:49.155720 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Getting quotas for user 75a9903b3597458f8f5af4d06cd07d4c and project ad57e412dc1e46c39f1121f3e4ca8ee9. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:02:49.168317 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:02:49.170615 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:02:49.218547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-df440aaa-24dc-4292-9ad5-8cc4c4c03340 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601439 Jul 14 11:02:49.219192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 331/665] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:02:49.229563 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8a2176e1-edb5-4f81-b57d-1bb4723f4363 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:49.230127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8a2176e1-edb5-4f81-b57d-1bb4723f4363 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:49.285719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8a2176e1-edb5-4f81-b57d-1bb4723f4363 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:49.294524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8a2176e1-edb5-4f81-b57d-1bb4723f4363 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1218 microversion: 2.1 time: 0.069189 Jul 14 11:02:49.295153 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 335/666] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:49 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:50.059800 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:50.060582 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:50.070454 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:50.071127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:50.072481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:50.073149 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:50.092227 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] HTTP exception thrown: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Request method failure captured: Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 HTTP/1.1 Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqcNjuEUVGHSjHTMqWwXHNAkUNOxta8J4YqBirXQM2nEXri23He0sQsJSwxloPpLCyprxRysP2vHn4-vbU-ndC8Lh2jPK8Vyj0w5PGuZ-V5mqvjoEQaj4FQqL1EAz2SE6yH85bLW_DCY5Kk-UqEY38qpzOOw-g82ddAoKl8FL06rs Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:02:50.094188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3160540122441ce970560d7a3db2521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3160540122441ce970560d7a3db2521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 6ead76e4f3564d6eb614bb911ccaf674 Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.095710 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '6afebadb-23f7-4429-975a-0835aeb84cb7'} Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:02:50.096647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.098113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.099603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Returning 404 to user: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:02:50.099603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bf638c91-74f1-4ffa-94ef-b4ce1a16e2ec tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 404 len: 111 microversion: 2.1 time: 0.042950 Jul 14 11:02:50.099603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 332/667] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:02:50 2022] DELETE /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:50.105706 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:50.106325 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 6afebadb-23f7-4429-975a-0835aeb84cb7] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:50.112426 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:50.112869 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:50.113632 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:50.114040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:50.135103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] HTTP exception thrown: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Request method failure captured: Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 HTTP/1.1 Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZqcNjuEUVGHSjHTMqWwXHNAkUNOxta8J4YqBirXQM2nEXri23He0sQsJSwxloPpLCyprxRysP2vHn4-vbU-ndC8Lh2jPK8Vyj0w5PGuZ-V5mqvjoEQaj4FQqL1EAz2SE6yH85bLW_DCY5Kk-UqEY38qpzOOw-g82ddAoKl8FL06rs Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:02:50.136861 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3160540122441ce970560d7a3db2521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3160540122441ce970560d7a3db2521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 6ead76e4f3564d6eb614bb911ccaf674 Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.138621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '6afebadb-23f7-4429-975a-0835aeb84cb7'} Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:02:50.139342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. Jul 14 11:02:50.140697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:50.141784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Returning 404 to user: Instance 6afebadb-23f7-4429-975a-0835aeb84cb7 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:02:50.141784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-712c7c13-8670-450c-b9dc-aeaa61845b72 tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7" status: 404 len: 111 microversion: 2.1 time: 0.037857 Jul 14 11:02:50.141784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 336/668] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:50 2022] GET /compute/v2.1/servers/6afebadb-23f7-4429-975a-0835aeb84cb7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:50.312041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:50.312981 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:50.319393 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:50.319907 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:50.320726 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:50.321181 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:50.423603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:50.432326 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4a105b4e-156a-4c19-8789-ba393a273d95 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1288 microversion: 2.1 time: 0.124097 Jul 14 11:02:50.433340 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 333/669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:50 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:51.287262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:51.287817 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:51.295069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.295515 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.296370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.296797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.311591 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] HTTP exception thrown: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Request method failure captured: Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d HTTP/1.1 Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZqcNjuEUVGHSjHTMqWwXHNAkUNOxta8J4YqBirXQM2nEXri23He0sQsJSwxloPpLCyprxRysP2vHn4-vbU-ndC8Lh2jPK8Vyj0w5PGuZ-V5mqvjoEQaj4FQqL1EAz2SE6yH85bLW_DCY5Kk-UqEY38qpzOOw-g82ddAoKl8FL06rs Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:02:51.313288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3160540122441ce970560d7a3db2521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3160540122441ce970560d7a3db2521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 6ead76e4f3564d6eb614bb911ccaf674 Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.314876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '43f20d4c-65f1-4c7c-b436-c1f4db0b527d'} Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:02:51.315637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.316928 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.318335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Returning 404 to user: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:02:51.318335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-06ee407a-8ed6-465f-a50f-5882f494a0fe tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 404 len: 111 microversion: 2.1 time: 0.031546 Jul 14 11:02:51.318335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 337/670] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:02:51 2022] DELETE /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:51.323390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:51.324034 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] [instance: 43f20d4c-65f1-4c7c-b436-c1f4db0b527d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:51.331980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.332115 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.332923 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.333684 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.348472 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] HTTP exception thrown: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Request method failure captured: Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d HTTP/1.1 Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZqcNjuEUVGHSjHTMqWwXHNAkUNOxta8J4YqBirXQM2nEXri23He0sQsJSwxloPpLCyprxRysP2vHn4-vbU-ndC8Lh2jPK8Vyj0w5PGuZ-V5mqvjoEQaj4FQqL1EAz2SE6yH85bLW_DCY5Kk-UqEY38qpzOOw-g82ddAoKl8FL06rs Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:02:51.350066 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3160540122441ce970560d7a3db2521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3160540122441ce970560d7a3db2521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3160540122441ce970560d7a3db2521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: a3160540122441ce970560d7a3db2521 Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1549411134 Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 6ead76e4f3564d6eb614bb911ccaf674 Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeTestJSON-1549411134-project Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.351658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '43f20d4c-65f1-4c7c-b436-c1f4db0b527d'} Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:02:51.352762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. Jul 14 11:02:51.354220 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:02:51.355307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] Returning 404 to user: Instance 43f20d4c-65f1-4c7c-b436-c1f4db0b527d could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:02:51.355307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5ae70d06-0006-4a01-9305-8061f11cc8cd tempest-AttachVolumeTestJSON-1549411134 tempest-AttachVolumeTestJSON-1549411134-project] 10.222.0.27 "GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d" status: 404 len: 111 microversion: 2.1 time: 0.031994 Jul 14 11:02:51.355307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 334/671] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:51 2022] GET /compute/v2.1/servers/43f20d4c-65f1-4c7c-b436-c1f4db0b527d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:51.450941 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:51.451579 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:51.458619 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.458795 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.459443 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.459908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.684557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-2cb50cb1-1225-430a-90b4-f2e6d8557ed0 req-9485dfdb-80d2-4c2b-9c75-3729cf985b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265d02e5-d9fa-4129-8df4-1e4cb0550540", "tag": "b97863c4-bab5-4620-bee9-4706d2fdb2ba"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:51.695996 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-2cb50cb1-1225-430a-90b4-f2e6d8557ed0 req-9485dfdb-80d2-4c2b-9c75-3729cf985b5a service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:51.697123 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-2cb50cb1-1225-430a-90b4-f2e6d8557ed0 req-9485dfdb-80d2-4c2b-9c75-3729cf985b5a service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:51.711531 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-2cb50cb1-1225-430a-90b4-f2e6d8557ed0 req-9485dfdb-80d2-4c2b-9c75-3729cf985b5a service nova] Creating event network-changed:b97863c4-bab5-4620-bee9-4706d2fdb2ba for instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 on hv-cinder-84614 Jul 14 11:02:51.717412 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-2cb50cb1-1225-430a-90b4-f2e6d8557ed0 req-9485dfdb-80d2-4c2b-9c75-3729cf985b5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039614 Jul 14 11:02:51.717976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 335/672] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:51.744445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:51.759729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fe452e9d-7220-4c6e-adee-c37c5d7cf646 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.313441 Jul 14 11:02:51.769588 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 338/673] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:51 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:52.779162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:52.780250 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:52.787017 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:52.787460 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:52.788250 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:52.788681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:53.022730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:53.031906 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9364c3ce-f4b1-46ab-a833-671bc168bd5d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.257159 Jul 14 11:02:53.032487 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 336/674] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:52 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:54.049634 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:54.050807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:54.058377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:54.058854 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:54.059692 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:54.060547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:54.196037 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:54.204360 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-20380789-7a54-49db-83f6-a970a7f04372 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.158671 Jul 14 11:02:54.204924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 339/675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:54 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:55.221717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:55.224656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:55.232469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:55.233087 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:55.234012 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:55.234591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:55.258599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=100 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:55.378065 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:55.386018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9b273ed7-e242-400f-9241-1a4e42e56dc1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.168268 Jul 14 11:02:55.386588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 337/676] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:55 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:02:56.402953 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:56.404228 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:56.411782 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:56.412617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:56.413587 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:56.414190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:56.632860 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:56.641102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2ca86bd7-37a7-43a8-9b45-e74bfc3c21ef tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.242043 Jul 14 11:02:56.641925 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 340/677] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:56 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:57.452153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-983baaa2-421f-4b18-8a56-9f55a35a37ee req-b7327684-3e8a-48ff-b340-539bb575a2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265d02e5-d9fa-4129-8df4-1e4cb0550540", "name": "network-vif-plugged", "status": "completed", "tag": "b97863c4-bab5-4620-bee9-4706d2fdb2ba"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:02:57.467093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-983baaa2-421f-4b18-8a56-9f55a35a37ee req-b7327684-3e8a-48ff-b340-539bb575a2e3 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:57.467537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-983baaa2-421f-4b18-8a56-9f55a35a37ee req-b7327684-3e8a-48ff-b340-539bb575a2e3 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:57.481989 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-983baaa2-421f-4b18-8a56-9f55a35a37ee req-b7327684-3e8a-48ff-b340-539bb575a2e3 service nova] Creating event network-vif-plugged:b97863c4-bab5-4620-bee9-4706d2fdb2ba for instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 on hv-cinder-84614 Jul 14 11:02:57.488144 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-983baaa2-421f-4b18-8a56-9f55a35a37ee req-b7327684-3e8a-48ff-b340-539bb575a2e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039527 Jul 14 11:02:57.489009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 338/678] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:02:57.666515 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:57.673421 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:57.687856 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:57.688858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:57.690464 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:57.704725 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:57.857293 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:57.889053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f690efd1-ec4f-4660-8f96-bad2047d495a tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.234244 Jul 14 11:02:57.892238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 341/679] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:57 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:02:58.908662 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:02:58.909424 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:02:58.925345 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:58.925808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:58.926611 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:02:58.927050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:02:59.142188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:59.163382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=6 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:59.472107 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:02:59.480090 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-eae990c3-80ee-446e-ba0a-5a33eacf4aed tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1318 microversion: 2.1 time: 0.577819 Jul 14 11:02:59.480764 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 339/680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:02:58 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:00.453410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:00.497948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:00.498562 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:00.505658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:00.506353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:00.507096 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:00.507741 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:00.571910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-92467f3b-d7b0-4389-b6f1-6ad0e3ec8df1 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: .version_select at 0x7f13d43d8790>, body: {"keypair": {"name": "tempest-keypair-600895686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNHJ8nW4tYSUqloZ12pAOFhDfNR5tOUBm60OptgHc4GKRAwmVJSbmz+HQ5Dm7H6yqwqqyBMOfHTOt3zN+dRJrC39s0SgXHZgVlv9CetGne91tHp1OTsQy2Cly1ZrG1wg=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:00.586213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-92467f3b-d7b0-4389-b6f1-6ad0e3ec8df1 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:03:00.590170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-92467f3b-d7b0-4389-b6f1-6ad0e3ec8df1 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:03:00.618483 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-92467f3b-d7b0-4389-b6f1-6ad0e3ec8df1 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169991 Jul 14 11:03:00.624788 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 342/681] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:03:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:00.651141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:00.659191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8de79524-59b7-4422-8349-a41586d61c20 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1506 microversion: 2.1 time: 0.165084 Jul 14 11:03:00.659768 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 340/682] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:00 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:02.021605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-690397894", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42115c3-3c7a-438d-89c4-e806c3160582"}], "security_groups": [{"name": "tempest-securitygroup--1150384851"}], "key_name": "tempest-keypair-600895686", "user_data": "}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:02.135163 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] validate_networks() for [('a42115c3-3c7a-438d-89c4-e806c3160582', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:03:02.692647 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:03:02.693349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:03:02.693912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:03:02.694409 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:03:02.694922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:03:02.704006 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:02.704530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:02.705436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:02.706004 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:02.725797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:03:02.730043 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:03:02.741015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:03:02.743395 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:03:02.796555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2e906f6b-56e3-4984-bf31-bacfe0add723 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779827 Jul 14 11:03:02.797310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 343/683] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:03:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:03:02.807688 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-106779aa-4d00-46e9-ba87-bd66126f3b31 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:02.809092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-106779aa-4d00-46e9-ba87-bd66126f3b31 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:02.895743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-106779aa-4d00-46e9-ba87-bd66126f3b31 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:02.903270 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-106779aa-4d00-46e9-ba87-bd66126f3b31 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1240 microversion: 2.1 time: 0.099630 Jul 14 11:03:02.904117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 341/684] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:02 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:03.921931 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:03.923858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:03.932938 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:03.933838 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:03.935140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:03.935787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:03.945974 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:03.946951 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:03.955237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:03.956016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:03.957070 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:03.957857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:03.994302 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1dbc1113-8814-4f3a-88dd-cc1fdce7ca91 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052466 Jul 14 11:03:03.995616 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 342/685] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 11:03:03 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:04.058720 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:04.059322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:04.059987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:04.068434 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:04.068975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:04.069770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e2e0787c-49d3-41c1-9e34-7305ccd57113 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1292 microversion: 2.1 time: 0.152426 Jul 14 11:03:04.069897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:04.070375 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:04.070864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 344/686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:03 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:04.097479 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:03:04.187152 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a97c4625-fbd5-4eca-a1e8-859b755c32f2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 204 len: 0 microversion: 2.20 time: 0.132553 Jul 14 11:03:04.187765 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 343/687] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 11:03:04 2022] DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:03:04.196634 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:04.198009 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:04.205818 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:04.206681 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:04.207835 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:04.208735 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:04.382427 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:04.390939 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:04.392543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:04.393716 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c4db7798-72f0-4e56-b655-679397d13657 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.201598 Jul 14 11:03:04.394288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 345/688] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:03:04 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:03:05.087662 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:05.088568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:05.095530 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:05.096026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:05.096849 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:05.097322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:05.171415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:05.182412 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2948263c-0825-4d2e-a21b-035489af812f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1298 microversion: 2.1 time: 0.099272 Jul 14 11:03:05.182922 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 344/689] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:05 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:05.412693 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:05.413305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:05.416290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:05.422387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:05.422913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:05.423659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:05.424138 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:05.608748 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:05.617629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:05.619346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:05.620532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f6704276-1bb4-43b7-8b49-a83fc8c565df tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.212013 Jul 14 11:03:05.621084 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 346/690] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:03:05 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:03:06.203967 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:06.204751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:06.207124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:06.213678 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:06.214132 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:06.214928 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:06.215364 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:06.556991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:06.565503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9f7da220-86c9-4327-b2a3-c82ddcb75450 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.365645 Jul 14 11:03:06.566643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 345/691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:06 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:06.641858 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:06.642458 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:06.649221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:06.649751 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:06.651140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:06.651648 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:06.656752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:07.311080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:07.324560 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:07.326342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4012911dad42edbffead00e0fd55e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1f327753b4708b0940964aa3d761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:07.327735 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3e624511-48de-44bb-a9be-6dcf9ce2a8b2 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 200 len: 1724 microversion: 2.20 time: 0.690248 Jul 14 11:03:07.328332 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 347/692] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:03:06 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 1724 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:03:07.584255 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:07.584881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:07.592806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:07.593557 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:07.594342 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:07.594760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:07.719899 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-d19672d1-3081-4827-81cc-c56304dd5ee9 req-6f8ce65b-3938-4261-82d1-996e46c37fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df900805-d79f-4c36-b6b8-8aef7ecd5c6c", "name": "network-vif-deleted", "tag": "88d8238d-6727-48a5-a8a2-dde01ba9cc28"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:07.750321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-d19672d1-3081-4827-81cc-c56304dd5ee9 req-6f8ce65b-3938-4261-82d1-996e46c37fa3 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:07.775962 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-d19672d1-3081-4827-81cc-c56304dd5ee9 req-6f8ce65b-3938-4261-82d1-996e46c37fa3 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:07.810541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-d19672d1-3081-4827-81cc-c56304dd5ee9 req-6f8ce65b-3938-4261-82d1-996e46c37fa3 service nova] Creating event network-vif-deleted:88d8238d-6727-48a5-a8a2-dde01ba9cc28 for instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c on hv-cinder-84614 Jul 14 11:03:07.823782 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-d19672d1-3081-4827-81cc-c56304dd5ee9 req-6f8ce65b-3938-4261-82d1-996e46c37fa3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107993 Jul 14 11:03:07.829404 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 348/693] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:07.873212 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:07.882342 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-56e6b233-d724-476e-921e-313553163a08 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.302071 Jul 14 11:03:07.895070 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 346/694] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:07 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:08.349496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:08.350515 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:08.358051 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:08.358575 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:08.359428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:08.359891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:08.378408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] HTTP exception thrown: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Request method failure captured: Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c HTTP/1.1 Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZwhP3GDdf8Cq5tPajxlriUF86Q5_GA1KEKmXQLKXuairG-3DZTsg5lPdGXuqCEcKkCjcVnu1FXfxpaE3ByqoZpHOSZKxnjLNeAKWLrLOd6iD8Ibd4fx90B817pEWv1o3hKyti-5RyOxzEl17Oy08GXwyk768CeQvWpMRvAMRZI98c Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:03:08.380167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 3e4012911dad42edbffead00e0fd55e6 Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:08.381545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'df900805-d79f-4c36-b6b8-8aef7ecd5c6c'} Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:03:08.382282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:08.383468 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:08.384611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Returning 404 to user: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:03:08.384611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-39f335c0-f9c0-4ff2-918a-30957bb60f94 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 404 len: 111 microversion: 2.20 time: 0.038568 Jul 14 11:03:08.384611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 349/695] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:03:08 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:03:08.391068 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d821a189-fc2a-4962-8179-9c170d4789dd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '.version_select at 0x7f13d4379550>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:08.411828 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d821a189-fc2a-4962-8179-9c170d4789dd tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113644461" status: 204 len: 0 microversion: 2.20 time: 0.024585 Jul 14 11:03:08.412508 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 347/696] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jul 14 11:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113644461 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:03:08.901001 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:08.901867 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:08.924886 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:08.926223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:08.930578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:08.932088 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:09.082326 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:09.099974 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-95f80632-fd99-4cd4-be57-53e1b25e515d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.203105 Jul 14 11:03:09.100543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 350/697] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:08 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:09.842850 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-10d81da9-3cae-473d-a35d-a532fdb0e876 req-1385158d-193d-41f8-a0f8-89b6f09819c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73519f9-0e9d-41ab-ba9b-619cf97f8822", "tag": "11644f03-c090-4846-901d-f5aed3780ac3"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:09.854782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-10d81da9-3cae-473d-a35d-a532fdb0e876 req-1385158d-193d-41f8-a0f8-89b6f09819c9 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:09.855161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-10d81da9-3cae-473d-a35d-a532fdb0e876 req-1385158d-193d-41f8-a0f8-89b6f09819c9 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:09.865736 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-10d81da9-3cae-473d-a35d-a532fdb0e876 req-1385158d-193d-41f8-a0f8-89b6f09819c9 service nova] Creating event network-changed:11644f03-c090-4846-901d-f5aed3780ac3 for instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 on hv-cinder-84614 Jul 14 11:03:09.871196 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-10d81da9-3cae-473d-a35d-a532fdb0e876 req-1385158d-193d-41f8-a0f8-89b6f09819c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032593 Jul 14 11:03:09.871778 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 348/698] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:10.117688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:10.118428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:10.127394 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:10.127837 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:10.128655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:10.129089 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:10.237119 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:10.237731 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:10.244165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:10.244617 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:10.245392 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:10.245810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:10.260136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] HTTP exception thrown: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Request method failure captured: Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c HTTP/1.1 Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZwhP3GDdf8Cq5tPajxlriUF86Q5_GA1KEKmXQLKXuairG-3DZTsg5lPdGXuqCEcKkCjcVnu1FXfxpaE3ByqoZpHOSZKxnjLNeAKWLrLOd6iD8Ibd4fx90B817pEWv1o3hKyti-5RyOxzEl17Oy08GXwyk768CeQvWpMRvAMRZI98c Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:03:10.262186 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 3e4012911dad42edbffead00e0fd55e6 Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.263663 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'df900805-d79f-4c36-b6b8-8aef7ecd5c6c'} Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:03:10.265356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.266834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.268044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Returning 404 to user: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:03:10.268044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-92c8c5c5-1a6f-478c-9536-8503f7a1cb03 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 404 len: 111 microversion: 2.20 time: 0.030972 Jul 14 11:03:10.268044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 349/699] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 11:03:10 2022] DELETE /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:03:10.271971 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:10.272580 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: df900805-d79f-4c36-b6b8-8aef7ecd5c6c] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:10.279024 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:10.279728 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:10.280915 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:10.281366 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:10.296747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] HTTP exception thrown: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Request method failure captured: Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c HTTP/1.1 Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_ZwhP3GDdf8Cq5tPajxlriUF86Q5_GA1KEKmXQLKXuairG-3DZTsg5lPdGXuqCEcKkCjcVnu1FXfxpaE3ByqoZpHOSZKxnjLNeAKWLrLOd6iD8Ibd4fx90B817pEWv1o3hKyti-5RyOxzEl17Oy08GXwyk768CeQvWpMRvAMRZI98c Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:03:10.298480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 3e4012911dad42edbffead00e0fd55e6 Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.299908 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'df900805-d79f-4c36-b6b8-8aef7ecd5c6c'} Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:03:10.300675 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. Jul 14 11:03:10.301888 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:10.302963 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Returning 404 to user: Instance df900805-d79f-4c36-b6b8-8aef7ecd5c6c could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:03:10.302963 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-22a81e9a-2f98-4a36-8ccd-0d8cc0060ea7 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c" status: 404 len: 111 microversion: 2.20 time: 0.031763 Jul 14 11:03:10.302963 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 350/700] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:03:10 2022] GET /compute/v2.1/servers/df900805-d79f-4c36-b6b8-8aef7ecd5c6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:03:10.372767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:10.382349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-848d0306-a403-4a44-8059-db899de9705c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.268627 Jul 14 11:03:10.382932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 351/701] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:10 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:11.401647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:11.402213 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:11.409829 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:11.410271 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:11.411027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:11.411455 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:11.453625 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:11.454121 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:11.461048 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:11.461501 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:11.462282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:11.462710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:11.478539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] HTTP exception thrown: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Request method failure captured: Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 HTTP/1.1 Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZwhP3GDdf8Cq5tPajxlriUF86Q5_GA1KEKmXQLKXuairG-3DZTsg5lPdGXuqCEcKkCjcVnu1FXfxpaE3ByqoZpHOSZKxnjLNeAKWLrLOd6iD8Ibd4fx90B817pEWv1o3hKyti-5RyOxzEl17Oy08GXwyk768CeQvWpMRvAMRZI98c Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:03:11.480663 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 3e4012911dad42edbffead00e0fd55e6 Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.482103 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '049f0944-f485-4674-9518-e2b0c244c2c6'} Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:03:11.483157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.485107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.486956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Returning 404 to user: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:03:11.486956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f3c128a4-8ba9-4bef-b549-125b1209570b tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 404 len: 111 microversion: 2.20 time: 0.032451 Jul 14 11:03:11.486956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 352/702] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 11:03:11 2022] DELETE /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:03:11.491587 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:11.492225 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] [instance: 049f0944-f485-4674-9518-e2b0c244c2c6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:11.498821 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:11.499275 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:11.500079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:11.500486 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:11.515633 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] HTTP exception thrown: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Request method failure captured: Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 HTTP/1.1 Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_ZwhP3GDdf8Cq5tPajxlriUF86Q5_GA1KEKmXQLKXuairG-3DZTsg5lPdGXuqCEcKkCjcVnu1FXfxpaE3ByqoZpHOSZKxnjLNeAKWLrLOd6iD8Ibd4fx90B817pEWv1o3hKyti-5RyOxzEl17Oy08GXwyk768CeQvWpMRvAMRZI98c Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:03:11.517499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff1f327753b4708b0940964aa3d761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 2ff1f327753b4708b0940964aa3d761c Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345321771 Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 3e4012911dad42edbffead00e0fd55e6 Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345321771-project Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.518942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '049f0944-f485-4674-9518-e2b0c244c2c6'} Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:03:11.519734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. Jul 14 11:03:11.521429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:03:11.522744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] Returning 404 to user: Instance 049f0944-f485-4674-9518-e2b0c244c2c6 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:03:11.522744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-90f19522-0489-418d-92be-3d1581daab55 tempest-AttachVolumeShelveTestJSON-1345321771 tempest-AttachVolumeShelveTestJSON-1345321771-project] 10.222.0.27 "GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6" status: 404 len: 111 microversion: 2.20 time: 0.031147 Jul 14 11:03:11.522744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 353/703] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 11:03:11 2022] GET /compute/v2.1/servers/049f0944-f485-4674-9518-e2b0c244c2c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:03:11.566774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:11.577168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-cda1be02-6db6-43bb-95f7-a8bb5bb01357 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.180990 Jul 14 11:03:11.585116 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 351/704] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:11 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:12.595517 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:12.596349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:12.604777 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:12.605385 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:12.606270 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:12.606773 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:12.717260 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:12.736569 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=10 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:12.773812 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:12.792529 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-47ea1008-c531-429a-a446-098fbf00f82a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.200892 Jul 14 11:03:12.793694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 354/705] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:12 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:13.264288 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-b36fb5c8-4887-4a01-8e5a-67bdf67a244c req-dc8865ad-ecf7-4f37-88ab-11ae2537f5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73519f9-0e9d-41ab-ba9b-619cf97f8822", "name": "network-vif-plugged", "status": "completed", "tag": "11644f03-c090-4846-901d-f5aed3780ac3"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:13.273438 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:13.283568 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-b36fb5c8-4887-4a01-8e5a-67bdf67a244c req-dc8865ad-ecf7-4f37-88ab-11ae2537f5d6 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:13.284055 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-b36fb5c8-4887-4a01-8e5a-67bdf67a244c req-dc8865ad-ecf7-4f37-88ab-11ae2537f5d6 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:13.297478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-b36fb5c8-4887-4a01-8e5a-67bdf67a244c req-dc8865ad-ecf7-4f37-88ab-11ae2537f5d6 service nova] Creating event network-vif-plugged:11644f03-c090-4846-901d-f5aed3780ac3 for instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 on hv-cinder-84614 Jul 14 11:03:13.304548 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-b36fb5c8-4887-4a01-8e5a-67bdf67a244c req-dc8865ad-ecf7-4f37-88ab-11ae2537f5d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045730 Jul 14 11:03:13.306250 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 352/706] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:13.811022 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:13.811827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:13.831249 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:13.832469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:13.833685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:13.836094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:13.991742 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:13.999735 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5061f939-267d-43f3-ae36-5e647e77beee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.192938 Jul 14 11:03:14.000344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 355/707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:13 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:15.017985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:15.019120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:15.030142 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:15.031238 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:15.033721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:15.034606 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:15.201852 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:15.209448 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d0f35ec6-fc30-4616-b719-175ece9406d7 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1366 microversion: 2.1 time: 0.195801 Jul 14 11:03:15.210100 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 353/708] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:15 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:16.015159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0642bfdd-286d-4297-b759-8e9bd1eeae34", "device": "/dev/sdb"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:16.016762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:16.023277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:16.023746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:16.024547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:16.024970 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:16.226865 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:16.227489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:16.234941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:16.235396 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:16.236205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:16.236681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:16.268577 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-60f0f275-805c-4649-8d49-10a6356a04b0 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "POST /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257014 Jul 14 11:03:16.269813 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 356/709] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:03:16 2022] POST /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:16.387514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:16.395751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f14bd77f-e336-4393-834b-9019797ab38a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1556 microversion: 2.1 time: 0.172845 Jul 14 11:03:16.396351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 354/710] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:16 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:16.416429 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:16.417012 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:16.425183 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:16.425630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:16.426405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:16.426829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:16.530248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0002c4be-53c5-4385-8d93-3da9de9f4efa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120157 Jul 14 11:03:16.532054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 357/711] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 11:03:16 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:17.602358 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-85d82287-ae33-445a-b21d-2ebb09bc4dff tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d4343d30>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:17.650348 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-85d82287-ae33-445a-b21d-2ebb09bc4dff tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c5e1ba1d-42bb-4205-827d-ea06514e01bc" status: 200 len: 350 microversion: 2.1 time: 0.051755 Jul 14 11:03:17.651426 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 355/712] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:03:17 2022] GET /compute/v2.1/os-volumes/c5e1ba1d-42bb-4205-827d-ea06514e01bc => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:17.844602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-00cd9de0-339f-4b0e-8d51-4abf1155d215 req-83e1f8df-c7a5-4fc3-ac9c-7e15d476056c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73519f9-0e9d-41ab-ba9b-619cf97f8822", "tag": "11644f03-c090-4846-901d-f5aed3780ac3"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:17.853159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-00cd9de0-339f-4b0e-8d51-4abf1155d215 req-83e1f8df-c7a5-4fc3-ac9c-7e15d476056c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:17.853590 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-00cd9de0-339f-4b0e-8d51-4abf1155d215 req-83e1f8df-c7a5-4fc3-ac9c-7e15d476056c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:17.868044 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-00cd9de0-339f-4b0e-8d51-4abf1155d215 req-83e1f8df-c7a5-4fc3-ac9c-7e15d476056c service nova] Creating event network-changed:11644f03-c090-4846-901d-f5aed3780ac3 for instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 on hv-cinder-84614 Jul 14 11:03:17.873216 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-00cd9de0-339f-4b0e-8d51-4abf1155d215 req-83e1f8df-c7a5-4fc3-ac9c-7e15d476056c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170072 Jul 14 11:03:17.873828 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 358/713] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:19.012835 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c4583738-2af4-43a7-9fd2-b77b879e84b4 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d4334e50>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:19.061662 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c4583738-2af4-43a7-9fd2-b77b879e84b4 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3ceb6a0c-219b-4609-9b13-a42204c6613d" status: 200 len: 350 microversion: 2.1 time: 0.053473 Jul 14 11:03:19.062254 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 356/714] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:03:19 2022] GET /compute/v2.1/os-volumes/3ceb6a0c-219b-4609-9b13-a42204c6613d => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:20.394193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0f000078-6990-4c42-b918-26964cc57407 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d439a8b0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:20.450840 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0f000078-6990-4c42-b918-26964cc57407 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/09f080de-a882-4efc-bdc3-186c39e83ebd" status: 200 len: 351 microversion: 2.1 time: 0.061306 Jul 14 11:03:20.451433 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 359/715] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes/09f080de-a882-4efc-bdc3-186c39e83ebd => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:20.463476 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-20910f8f-c61b-4480-a3ea-8214262b8ed6 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d438eaf0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:20.559727 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-20910f8f-c61b-4480-a3ea-8214262b8ed6 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.100792 Jul 14 11:03:20.560333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 357/716] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:20.572474 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-62dcdbc1-e8e1-45a5-ab2b-c263c7e069d9 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d430e5e0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:20.654614 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-62dcdbc1-e8e1-45a5-ab2b-c263c7e069d9 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084183 Jul 14 11:03:20.654614 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 360/717] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:20.667252 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-bcaae591-734f-4a63-b80b-204fec5c2aa4 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d4379dc0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:20.752322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-bcaae591-734f-4a63-b80b-204fec5c2aa4 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089747 Jul 14 11:03:20.752906 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 358/718] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:20.764929 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d3105f45-464d-474a-9131-0927464976a5 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d47020d0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:20.866740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d3105f45-464d-474a-9131-0927464976a5 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105593 Jul 14 11:03:20.867304 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 361/719] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:20.879101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4611e6fc-e7e5-4db0-946f-b35cb7e39616 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d4343d30>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:20.966145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4611e6fc-e7e5-4db0-946f-b35cb7e39616 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090838 Jul 14 11:03:20.966697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 359/720] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:20.979150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c63f1631-741b-45c9-bb2b-84a4ad4fc914 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d4420d30>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:21.060330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c63f1631-741b-45c9-bb2b-84a4ad4fc914 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085379 Jul 14 11:03:21.060876 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 362/721] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jul 14 11:03:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:21.078223 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e822eea5-bd90-45b5-9dfb-e4a7750c5b4f tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d438e9d0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:21.164386 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e822eea5-bd90-45b5-9dfb-e4a7750c5b4f tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092051 Jul 14 11:03:21.165198 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 360/722] 10.222.0.27 () {58 vars in 1187 bytes} [Thu Jul 14 11:03:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:03:21.179579 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-14e8c691-3fbe-4ead-9901-bff257e9e9e4 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] Calling method '.version_select at 0x7f13d430ec10>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:21.264428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-14e8c691-3fbe-4ead-9901-bff257e9e9e4 tempest-VolumesTestJSON-1886053493 tempest-VolumesTestJSON-1886053493-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091088 Jul 14 11:03:21.265017 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 363/723] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jul 14 11:03:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:41.106937 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:41.108135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:41.112976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:41.113548 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:41.121637 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:41.122245 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:41.123102 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:41.123561 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:41.210965 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lazy-loading 'services' on Instance uuid 265d02e5-d9fa-4129-8df4-1e4cb0550540 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:03:41.288602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e9e23c8d-0213-4a48-ab8e-855c8aaf158e tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "DELETE /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540/os-volume_attachments/0642bfdd-286d-4297-b759-8e9bd1eeae34" status: 202 len: 0 microversion: 2.1 time: 0.182709 Jul 14 11:03:41.289211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 361/724] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:03:41 2022] DELETE /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540/os-volume_attachments/0642bfdd-286d-4297-b759-8e9bd1eeae34 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:03:42.405615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=25 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:42.406482 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:42.410539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:42.411246 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:42.419768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:42.420282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:42.421083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:42.421519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:42.447492 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:03:42.532968 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2540eb35-e70a-4380-90d0-bbc828e6d077 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "DELETE /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 204 len: 0 microversion: 2.1 time: 0.128070 Jul 14 11:03:42.533692 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 364/725] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:03:42 2022] DELETE /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:42.543356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:42.544322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:42.550751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:42.551278 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:42.552150 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:42.552659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:42.688236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:42.695144 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3a1232f5-3d70-4d3b-8121-ef18525ae800 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1512 microversion: 2.1 time: 0.156644 Jul 14 11:03:42.695894 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 362/726] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:42 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:43.713263 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:43.715171 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:43.722111 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:43.722841 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:43.724026 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:43.725086 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:43.870278 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:43.880175 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1920948e-532f-4ebc-9e1f-0024dc8e77e5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1512 microversion: 2.1 time: 0.171625 Jul 14 11:03:43.881329 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 365/727] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:43 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:44.791374 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-b207a125-dbaf-4bb4-bdb4-4ad99db7d91b req-848fdf3a-8973-45fe-b9a4-ed4beb1178b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265d02e5-d9fa-4129-8df4-1e4cb0550540", "name": "network-vif-deleted", "tag": "b97863c4-bab5-4620-bee9-4706d2fdb2ba"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:44.800800 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-b207a125-dbaf-4bb4-bdb4-4ad99db7d91b req-848fdf3a-8973-45fe-b9a4-ed4beb1178b1 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:44.801256 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-b207a125-dbaf-4bb4-bdb4-4ad99db7d91b req-848fdf3a-8973-45fe-b9a4-ed4beb1178b1 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:44.812731 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-b207a125-dbaf-4bb4-bdb4-4ad99db7d91b req-848fdf3a-8973-45fe-b9a4-ed4beb1178b1 service nova] Creating event network-vif-deleted:b97863c4-bab5-4620-bee9-4706d2fdb2ba for instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 on hv-cinder-84614 Jul 14 11:03:44.818017 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-b207a125-dbaf-4bb4-bdb4-4ad99db7d91b req-848fdf3a-8973-45fe-b9a4-ed4beb1178b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031767 Jul 14 11:03:44.818615 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 363/728] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:03:44.900448 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:44.901632 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:44.908986 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:44.909533 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:44.910413 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:44.911158 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:44.956981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:44.957390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:44.957840 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lazy-loading 'fault' on Instance uuid 265d02e5-d9fa-4129-8df4-1e4cb0550540 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:03:44.998994 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:45.006827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a40696f8-c2f6-4ca1-b006-1d42182ec6d7 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 200 len: 1308 microversion: 2.1 time: 0.110880 Jul 14 11:03:45.007407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 366/729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:44 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:46.025858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:46.026558 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 265d02e5-d9fa-4129-8df4-1e4cb0550540] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:46.033274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:46.033725 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:46.034497 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:46.034925 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:46.048519 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] HTTP exception thrown: Instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 could not be found. Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Request method failure captured: Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 HTTP/1.1 Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fWm8rdesKS7FGBYlWE0IpV0ac5p4pcKu7FAkj5JGzoNJlpuiCCo0qPlkz_wu-ybDr3Oh40qZKWp6e-ZtEKbAJ49-kPrKEJlJqLAWJTNrtOVpRv-3sHwV-LLO5BcbJJLeavMLNz-5Lm_wELuZF9E2PCjRiAH7LyJjdrxTefT9OAd6U Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: ad57e412dc1e46c39f1121f3e4ca8ee9 Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1488142474 Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:03:46.050143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-VolumesSnapshotTestJSON-1488142474 Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: ad57e412dc1e46c39f1121f3e4ca8ee9 Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1488142474 Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-VolumesSnapshotTestJSON-1488142474-project Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 75a9903b3597458f8f5af4d06cd07d4c Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-VolumesSnapshotTestJSON-1488142474-project Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 could not be found. Jul 14 11:03:46.051514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '265d02e5-d9fa-4129-8df4-1e4cb0550540'} Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 could not be found. Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:03:46.053274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 could not be found. Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 could not be found. Jul 14 11:03:46.054555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:03:46.056006 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Returning 404 to user: Instance 265d02e5-d9fa-4129-8df4-1e4cb0550540 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:03:46.056006 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-734913a9-8612-4c0f-a508-1233cd575d91 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540" status: 404 len: 111 microversion: 2.1 time: 0.030831 Jul 14 11:03:46.056006 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 364/730] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:46 2022] GET /compute/v2.1/servers/265d02e5-d9fa-4129-8df4-1e4cb0550540 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:03:57.054620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1944787052", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "networks": [{"uuid": "98246864-f075-444e-af36-f06c7ce7baa5"}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:03:57.063653 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:57.064472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:57.113133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] validate_networks() for [('98246864-f075-444e-af36-f06c7ce7baa5', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:03:57.477415 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:03:57.477829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:03:57.478290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:03:57.478690 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:03:57.479090 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:03:57.488553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:57.489007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:57.489809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:57.490244 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:57.507572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Getting quotas for project ad57e412dc1e46c39f1121f3e4ca8ee9. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:03:57.511733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Getting quotas for user 75a9903b3597458f8f5af4d06cd07d4c and project ad57e412dc1e46c39f1121f3e4ca8ee9. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:03:57.523260 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:03:57.525740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:03:57.574543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-142724bc-196b-41a0-b26f-3ea1f3e632a6 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526003 Jul 14 11:03:57.580176 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 367/731] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:03:57.585565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5526ad6a-4504-4e15-926a-f80bdcc8b37f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:57.586567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5526ad6a-4504-4e15-926a-f80bdcc8b37f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:57.590430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=8 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:57.596827 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:57.656844 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5526ad6a-4504-4e15-926a-f80bdcc8b37f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:57.664665 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5526ad6a-4504-4e15-926a-f80bdcc8b37f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1219 microversion: 2.1 time: 0.083040 Jul 14 11:03:57.665402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 365/732] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:57 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:58.681639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:58.682480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:58.690644 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:58.691484 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:58.692683 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:58.693268 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:58.781013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:03:58.790488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-43430d28-5727-4797-96a0-eb92e73c2c92 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1277 microversion: 2.1 time: 0.113092 Jul 14 11:03:58.800828 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 368/733] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:58 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:59.808808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:03:59.809618 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:03:59.817550 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:59.818097 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:59.818977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:03:59.819421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:03:59.993586 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-4e557e65-e23a-4e59-8b9c-607f5c0082d2 req-156beaa6-e0e4-445b-bd73-f3b8fd586302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85be01ce-dab6-4286-86ca-da4dc9fc30db", "tag": "9515f671-40bd-4dd9-bfa8-0fc970732a2c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:00.011488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-4e557e65-e23a-4e59-8b9c-607f5c0082d2 req-156beaa6-e0e4-445b-bd73-f3b8fd586302 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:00.011942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-4e557e65-e23a-4e59-8b9c-607f5c0082d2 req-156beaa6-e0e4-445b-bd73-f3b8fd586302 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:00.025300 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-4e557e65-e23a-4e59-8b9c-607f5c0082d2 req-156beaa6-e0e4-445b-bd73-f3b8fd586302 service nova] Creating event network-changed:9515f671-40bd-4dd9-bfa8-0fc970732a2c for instance 85be01ce-dab6-4286-86ca-da4dc9fc30db on hv-cinder-84614 Jul 14 11:04:00.031459 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-4e557e65-e23a-4e59-8b9c-607f5c0082d2 req-156beaa6-e0e4-445b-bd73-f3b8fd586302 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042936 Jul 14 11:04:00.032348 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 369/734] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:00.064795 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:00.073443 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-efc6a541-7e22-4c95-9c6f-f95cae17b4d1 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.268822 Jul 14 11:04:00.074089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 366/735] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:03:59 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:01.091801 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:01.092564 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:01.099677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:01.100150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:01.100944 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:01.101355 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:01.298201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:01.306265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-09a29292-daa6-4f79-b50f-4b671beabb4b tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.219196 Jul 14 11:04:01.306829 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 370/736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:01 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:01.518936 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:01.519515 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:01.526853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:01.527310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:01.528229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:01.528671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:01.554900 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4883561f-a287-418b-a273-9c0eedd2b247 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/ips" status: 200 len: 150 microversion: 2.1 time: 0.040229 Jul 14 11:04:01.555671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 367/737] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:04:01 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:02.322764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:02.323315 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:02.330688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:02.331178 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:02.332243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:02.332428 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:02.474557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:02.482068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-78ba42aa-7e9e-4f8a-821a-f981becad4d8 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.163362 Jul 14 11:04:02.482625 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 371/738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:02 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:02.940756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edf3665-97fd-4f01-8509-abf206b32e32"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:02.942157 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:02.948940 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:02.949395 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:02.950178 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:02.950726 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:03.217877 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0831c5ee-a876-46f2-9496-b199739b51a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281943 Jul 14 11:04:03.218599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 368/739] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:04:02 2022] POST /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:03.499158 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:03.499908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:03.506852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:03.507296 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:03.508069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:03.508510 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:03.669506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:03.678266 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0d4c53d6-849a-4437-a6b0-361f7add5b6f tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.183421 Jul 14 11:04:03.678839 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 372/740] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:03 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:04.697516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:04.698225 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:04.705470 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:04.705927 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:04.706721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:04.707154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:04.852671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:04.861397 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5aa7a650-7770-47c2-a7b9-f9698caa6e11 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.168649 Jul 14 11:04:04.862033 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 369/741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:04 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:05.555797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-70a04d26-b057-44a9-a740-5ac77e45c139 req-e9a6d2e7-4417-412a-baff-5e377a3b6803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85be01ce-dab6-4286-86ca-da4dc9fc30db", "name": "network-vif-plugged", "status": "completed", "tag": "9515f671-40bd-4dd9-bfa8-0fc970732a2c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:05.567644 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-70a04d26-b057-44a9-a740-5ac77e45c139 req-e9a6d2e7-4417-412a-baff-5e377a3b6803 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:05.568018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-70a04d26-b057-44a9-a740-5ac77e45c139 req-e9a6d2e7-4417-412a-baff-5e377a3b6803 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:05.581415 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-70a04d26-b057-44a9-a740-5ac77e45c139 req-e9a6d2e7-4417-412a-baff-5e377a3b6803 service nova] Creating event network-vif-plugged:9515f671-40bd-4dd9-bfa8-0fc970732a2c for instance 85be01ce-dab6-4286-86ca-da4dc9fc30db on hv-cinder-84614 Jul 14 11:04:05.586675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-70a04d26-b057-44a9-a740-5ac77e45c139 req-e9a6d2e7-4417-412a-baff-5e377a3b6803 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036003 Jul 14 11:04:05.587267 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 373/742] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:05.880802 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:05.881527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:05.889708 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:05.890234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:05.891171 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:05.891682 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:06.037773 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:06.049876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a0250292-f83f-4875-90d1-ede01cd8e67d tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.173471 Jul 14 11:04:06.050631 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 370/743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:05 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:07.075381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:07.076330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:07.084030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.084402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.085382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.085982 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.309865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:07.319386 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e3988e4e-4b1c-4c7b-a467-3fd07d8f3c76 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1319 microversion: 2.1 time: 0.250127 Jul 14 11:04:07.329932 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 374/744] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:07 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:07.361250 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:07.361755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:07.371051 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-cbeac73e-c135-4980-babd-4df68163621f req-c9cdb365-b803-46be-b99e-b3a04a4c2d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:07.376910 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.380639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.383500 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.384040 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.387612 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-cbeac73e-c135-4980-babd-4df68163621f req-c9cdb365-b803-46be-b99e-b3a04a4c2d77 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.389846 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-cbeac73e-c135-4980-babd-4df68163621f req-c9cdb365-b803-46be-b99e-b3a04a4c2d77 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.415450 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-cbeac73e-c135-4980-babd-4df68163621f req-c9cdb365-b803-46be-b99e-b3a04a4c2d77 service nova] Creating event network-changed:52a6868d-1e75-44e8-b0bb-7af3b70e050a for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 on hv-cinder-84614 Jul 14 11:04:07.425475 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-cbeac73e-c135-4980-babd-4df68163621f req-c9cdb365-b803-46be-b99e-b3a04a4c2d77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059282 Jul 14 11:04:07.426161 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 375/745] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:07.434298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:04:07.559683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b02b9b28-1f17-4bce-8d53-ad1d1d694e28 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 204 len: 0 microversion: 2.1 time: 0.202507 Jul 14 11:04:07.564644 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 371/746] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:04:07 2022] DELETE /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:07.567053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.567895 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.573051 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:07.573948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:07.581296 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.581750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.582538 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:07.582983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:07.749584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:07.758649 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d3ae380a-b201-4f31-b6ad-2927d9c1fd10 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.192313 Jul 14 11:04:07.759432 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 376/747] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:07 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:04:08.337686 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:08.338968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:08.340625 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:08.346570 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:08.347017 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:08.347799 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:08.348379 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:08.490559 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:08.498315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-531e36eb-5670-4443-809b-a835cb150acc tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1508 microversion: 2.1 time: 0.165076 Jul 14 11:04:08.498863 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 372/748] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:08 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:08.514637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0066229-5b8f-4b30-8d6c-60fc741c7b1a", "device": "/dev/sdb"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:08.515823 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:08.523136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:08.523543 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:08.524359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:08.524796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:08.779846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:08.780674 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:08.789242 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:08.790065 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:08.791153 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:08.791735 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:08.893516 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e0b9ae44-5d8f-4e25-a9c7-256664d91a0c tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "POST /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382601 Jul 14 11:04:08.895495 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 377/749] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:04:08 2022] POST /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:08.981634 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:08.990605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e5ee2329-cbd2-44a7-a075-085354f56eed tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1568 microversion: 2.1 time: 0.216935 Jul 14 11:04:08.991453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 373/750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:08 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:10.010844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:10.011540 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:10.019201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:10.019844 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:10.021223 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:10.021954 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:10.099312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-1613ab73-4c7a-46e2-b33d-4e57a087c1d3 req-51fc015c-e0f2-49a3-8f3c-4bd94ee41c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd87eb15-0243-4ec1-8bd9-506a4c2a6a15", "name": "network-vif-deleted", "tag": "52a6868d-1e75-44e8-b0bb-7af3b70e050a"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:10.109774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-1613ab73-4c7a-46e2-b33d-4e57a087c1d3 req-51fc015c-e0f2-49a3-8f3c-4bd94ee41c5d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:10.110303 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-1613ab73-4c7a-46e2-b33d-4e57a087c1d3 req-51fc015c-e0f2-49a3-8f3c-4bd94ee41c5d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:10.120533 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600fb1135fe040e2aa1c03628da8bf93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2953bf079541b28189cc9ad88ad753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:10.123135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-1613ab73-4c7a-46e2-b33d-4e57a087c1d3 req-51fc015c-e0f2-49a3-8f3c-4bd94ee41c5d service nova] Creating event network-vif-deleted:52a6868d-1e75-44e8-b0bb-7af3b70e050a for instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 on hv-cinder-84614 Jul 14 11:04:10.131673 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e7021a67-7ad4-4b58-b59c-014d3ce5060f tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 200 len: 1381 microversion: 2.1 time: 0.126110 Jul 14 11:04:10.132312 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 378/751] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:10 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 1381 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:04:10.140363 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-1613ab73-4c7a-46e2-b33d-4e57a087c1d3 req-51fc015c-e0f2-49a3-8f3c-4bd94ee41c5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044600 Jul 14 11:04:10.141024 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 374/752] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:04:10.804167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-dc76ff74-0424-4028-8f27-421bb3d568cd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: .version_select at 0x7f13d430ff70>, body: {"keypair": {"name": "tempest-keypair-657092281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlkzLGogHbpyj4LxPRKCHN2cNTvvRaO5vRWDFaSBuBPrCICoz5QedsFAc6cF1o6ztjyLZuTxY+y1moWr1dqYes6z7wbYwreklGPSE6Kkp4jgu2VAfSF+Q//7uNQ/qRhSw=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:10.819538 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-dc76ff74-0424-4028-8f27-421bb3d568cd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:04:10.823617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-dc76ff74-0424-4028-8f27-421bb3d568cd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:04:10.848747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-dc76ff74-0424-4028-8f27-421bb3d568cd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048515 Jul 14 11:04:10.849397 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 379/753] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:04:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:11.150962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:11.151700 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] [instance: fd87eb15-0243-4ec1-8bd9-506a4c2a6a15] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:11.159355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:11.160283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:11.161140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:11.161584 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:11.177110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] HTTP exception thrown: Instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 could not be found. Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Request method failure captured: Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 HTTP/1.1 Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_bfmC6efhX9Y3sWmGCNN5vsSlxq4Vv5wMmD6oUiiRps7gn8R_wQ8Mw_WmHmXM4-SK7Jp1rySZ529Tukb2pfZviSMFFiy6Rj3OEw0Qss_-3KhFB6PC1Z0u-vcodVBa01MZ2xQEygTtEIyOdIzu-Pvg1RuNSgiYYR3rf_dm0LRbgFkaE Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 3d2953bf079541b28189cc9ad88ad753 Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-TestShelveInstance-31935541 Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:04:11.178878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d2953bf079541b28189cc9ad88ad753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d2953bf079541b28189cc9ad88ad753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d2953bf079541b28189cc9ad88ad753"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d2953bf079541b28189cc9ad88ad753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-TestShelveInstance-31935541 Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 3d2953bf079541b28189cc9ad88ad753 Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-TestShelveInstance-31935541 Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-TestShelveInstance-31935541-project Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 600fb1135fe040e2aa1c03628da8bf93 Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-TestShelveInstance-31935541-project Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 could not be found. Jul 14 11:04:11.180697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'fd87eb15-0243-4ec1-8bd9-506a4c2a6a15'} Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 could not be found. Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:04:11.181605 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 could not be found. Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 could not be found. Jul 14 11:04:11.183131 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:11.184410 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Returning 404 to user: Instance fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:04:11.184410 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0f20066f-16f7-4fe1-a3a1-15bc88bd0d31 tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15" status: 404 len: 111 microversion: 2.1 time: 0.034233 Jul 14 11:04:11.184410 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 375/754] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:11 2022] GET /compute/v2.1/servers/fd87eb15-0243-4ec1-8bd9-506a4c2a6a15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:04:11.404453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-dc97daf2-5bf4-4a47-bbe1-8d3cc1f8fbdb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] Calling method '.version_select at 0x7f13d42b6af0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:11.424781 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-dc97daf2-5bf4-4a47-bbe1-8d3cc1f8fbdb tempest-TestShelveInstance-31935541 tempest-TestShelveInstance-31935541-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1318760041" status: 202 len: 0 microversion: 2.1 time: 0.024925 Jul 14 11:04:11.425402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 380/755] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jul 14 11:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1318760041 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:04:12.982774 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-923741494", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42115c3-3c7a-438d-89c4-e806c3160582"}], "security_groups": [{"name": "tempest-securitygroup--1979451223"}], "key_name": "tempest-keypair-657092281", "user_data": "}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:13.147202 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] validate_networks() for [('a42115c3-3c7a-438d-89c4-e806c3160582', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:04:13.665267 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:04:13.667176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:04:13.667649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:04:13.674578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:04:13.676444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:04:13.702903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:13.703524 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:13.704912 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:13.705687 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:13.753169 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:04:13.759765 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:04:13.786870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:04:13.789835 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:04:13.848600 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-14bdcc25-7949-44f8-9e9c-bc90f88fa613 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.871761 Jul 14 11:04:13.849491 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 376/756] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:04:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:04:13.861334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-564ebc4e-1739-4f81-939c-915feb4c453a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:13.863915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-564ebc4e-1739-4f81-939c-915feb4c453a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:14.014690 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-564ebc4e-1739-4f81-939c-915feb4c453a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:14.024637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-564ebc4e-1739-4f81-939c-915feb4c453a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1240 microversion: 2.1 time: 0.167319 Jul 14 11:04:14.039041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 381/757] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:13 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:15.044632 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:15.045253 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:15.052043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:15.056537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:15.058342 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:15.059216 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:15.163023 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:15.178904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7b0a3ab3-1619-42fe-baaf-63b915cfcb90 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1300 microversion: 2.1 time: 0.137636 Jul 14 11:04:15.180189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 377/758] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:15 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:16.197141 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:16.197895 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:16.205202 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:16.205653 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:16.206506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:16.206944 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:16.490513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:16.510313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0f765035-b268-45c7-a3d0-5e892a2704df tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1298 microversion: 2.1 time: 0.317180 Jul 14 11:04:16.510887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 382/759] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:16 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:17.528429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:17.529403 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:17.544060 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:17.546826 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:17.547901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:17.548524 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:17.818073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:17.830319 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2b919c0e-e922-47c4-9ef4-d623b155cb1d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.305898 Jul 14 11:04:17.837487 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 378/760] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:17 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:18.849661 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:18.850356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:18.859634 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:18.862665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:18.865213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:18.865867 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:19.339756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:19.352238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e5a3ddf5-6046-4ec5-b362-9e67cfe804c6 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.506848 Jul 14 11:04:19.353587 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 383/761] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:18 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:20.055588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-95249204-523f-434b-a736-70a0f32a285e req-4c3d8acf-9986-48a2-9050-a01b503f97b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b0a3f5-054c-438a-a09a-510002782388", "tag": "63ae8504-e8d5-4423-bbf7-3c3704f1eaa0"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:20.085585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-95249204-523f-434b-a736-70a0f32a285e req-4c3d8acf-9986-48a2-9050-a01b503f97b8 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:20.086521 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-95249204-523f-434b-a736-70a0f32a285e req-4c3d8acf-9986-48a2-9050-a01b503f97b8 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:20.115266 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-95249204-523f-434b-a736-70a0f32a285e req-4c3d8acf-9986-48a2-9050-a01b503f97b8 service nova] Creating event network-changed:63ae8504-e8d5-4423-bbf7-3c3704f1eaa0 for instance 79b0a3f5-054c-438a-a09a-510002782388 on hv-cinder-84614 Jul 14 11:04:20.155392 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-95249204-523f-434b-a736-70a0f32a285e req-4c3d8acf-9986-48a2-9050-a01b503f97b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103520 Jul 14 11:04:20.156079 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 379/762] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:20.370849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:20.371568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:20.383808 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:20.384351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:20.387343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:20.387987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:20.666516 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:20.676344 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-01c126f2-2df1-4afa-8135-87734bbb3980 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.308792 Jul 14 11:04:20.684557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 384/763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:20 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:21.693205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:21.699154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:21.723177 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:21.724061 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:21.725080 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:21.725666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:21.928440 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:21.937443 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-87154795-b24d-4a87-b614-6ff32632727c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.249637 Jul 14 11:04:21.938408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 380/764] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:21 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:22.955001 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:22.955911 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:22.963796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:22.964481 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:22.965738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:22.966349 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:23.243857 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:23.256027 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-15c880e6-29c2-4ffb-8c13-24a5b1a783a5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.304833 Jul 14 11:04:23.257322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 385/765] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:22 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:24.273645 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:24.274991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:24.277979 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.279171 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=6 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.293539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:24.296480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:24.297525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:24.298288 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:24.746910 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:24.791243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a584dc01-5779-4058-980d-da9e1aee7cca tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.517113 Jul 14 11:04:24.793199 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 381/766] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:24 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:25.811011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:25.811642 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:25.821578 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:25.824391 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:25.825217 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:25.826360 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:25.827343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:26.105208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:26.131054 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-777772d5-8216-45c6-9808-aea2262b83d4 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.323076 Jul 14 11:04:26.134408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 386/767] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:25 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:26.827690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:26.828461 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:26.836256 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:26.836889 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:26.837810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:26.838399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:26.861551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:26.955636 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lazy-loading 'services' on Instance uuid 85be01ce-dab6-4286-86ca-da4dc9fc30db {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:04:27.069378 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-690676d8-72af-412f-97f3-3f0f0a51e8a2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db/os-volume_attachments/d0066229-5b8f-4b30-8d6c-60fc741c7b1a" status: 202 len: 0 microversion: 2.1 time: 0.245495 Jul 14 11:04:27.072786 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 382/768] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:04:26 2022] DELETE /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db/os-volume_attachments/d0066229-5b8f-4b30-8d6c-60fc741c7b1a => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:04:27.156289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:27.157919 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:27.183080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:27.189973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:27.191338 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:27.193386 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:27.193956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:27.197816 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.125355 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:28.136990 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1f140835-a7d9-4f31-8ccd-67aa36202708 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.988604 Jul 14 11:04:28.149568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 387/769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:27 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:28.347172 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:28.348436 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:28.354621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.356594 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:28.357380 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:28.358319 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:28.358896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:28.392447 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:04:28.502105 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5367be59-b380-4fe9-ab38-aa0f0734e009 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 204 len: 0 microversion: 2.1 time: 0.159355 Jul 14 11:04:28.508980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 383/770] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:04:28 2022] DELETE /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:28.514915 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:28.515662 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:28.530144 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:28.530974 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:28.532363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:28.533049 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:28.797343 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:28.808874 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e757eea6-3bba-4dea-9d15-bc522d106ec2 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1514 microversion: 2.1 time: 0.298223 Jul 14 11:04:28.827412 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 388/771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:28 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:29.163196 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:29.164255 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:29.175243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:29.176619 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:29.177683 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:29.178328 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:29.366193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-1e2fd28c-42c7-4f36-a0ca-300d146f2b16 req-b788a68a-860f-4ca9-82b1-d4e3d5dfcd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b0a3f5-054c-438a-a09a-510002782388", "name": "network-vif-plugged", "status": "completed", "tag": "63ae8504-e8d5-4423-bbf7-3c3704f1eaa0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:29.383923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1e2fd28c-42c7-4f36-a0ca-300d146f2b16 req-b788a68a-860f-4ca9-82b1-d4e3d5dfcd09 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:29.385248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1e2fd28c-42c7-4f36-a0ca-300d146f2b16 req-b788a68a-860f-4ca9-82b1-d4e3d5dfcd09 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:29.400290 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-1e2fd28c-42c7-4f36-a0ca-300d146f2b16 req-b788a68a-860f-4ca9-82b1-d4e3d5dfcd09 service nova] Creating event network-vif-plugged:63ae8504-e8d5-4423-bbf7-3c3704f1eaa0 for instance 79b0a3f5-054c-438a-a09a-510002782388 on hv-cinder-84614 Jul 14 11:04:29.409613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-1e2fd28c-42c7-4f36-a0ca-300d146f2b16 req-b788a68a-860f-4ca9-82b1-d4e3d5dfcd09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047029 Jul 14 11:04:29.410946 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 389/772] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:29.447467 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:29.465656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0a634d5e-6f0f-41e2-b10b-b6c147ddb675 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.311940 Jul 14 11:04:29.471076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 384/773] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:29 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:29.833881 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:29.834622 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:29.850769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:29.851213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:29.852015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:29.852447 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:30.487944 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:30.488556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:30.502231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:30.518978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:30.519837 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:30.520307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:30.637178 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:30.648508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-67a19614-6efc-4b89-a516-5886d2976187 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1514 microversion: 2.1 time: 0.824015 Jul 14 11:04:30.649101 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 390/774] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:29 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1514 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:30.951352 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:30.962410 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c545daf9-8be1-4e30-9401-4fa6eef2ede5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.480129 Jul 14 11:04:30.963733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 385/775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:30 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:31.594337 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-5ad1364e-a2a8-4889-b0c1-ace1e5f816a8 req-8523ac1b-c1e3-42c7-a0d3-1fa04e7d2b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85be01ce-dab6-4286-86ca-da4dc9fc30db", "name": "network-vif-deleted", "tag": "9515f671-40bd-4dd9-bfa8-0fc970732a2c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:31.619676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5ad1364e-a2a8-4889-b0c1-ace1e5f816a8 req-8523ac1b-c1e3-42c7-a0d3-1fa04e7d2b79 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:31.620526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-5ad1364e-a2a8-4889-b0c1-ace1e5f816a8 req-8523ac1b-c1e3-42c7-a0d3-1fa04e7d2b79 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:31.638237 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-5ad1364e-a2a8-4889-b0c1-ace1e5f816a8 req-8523ac1b-c1e3-42c7-a0d3-1fa04e7d2b79 service nova] Creating event network-vif-deleted:9515f671-40bd-4dd9-bfa8-0fc970732a2c for instance 85be01ce-dab6-4286-86ca-da4dc9fc30db on hv-cinder-84614 Jul 14 11:04:31.652053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-5ad1364e-a2a8-4889-b0c1-ace1e5f816a8 req-8523ac1b-c1e3-42c7-a0d3-1fa04e7d2b79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070038 Jul 14 11:04:31.654248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 391/776] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:31.666187 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:31.669088 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:31.682784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:31.683503 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:31.684583 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:31.685439 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:31.823064 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a9903b3597458f8f5af4d06cd07d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad57e412dc1e46c39f1121f3e4ca8ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:31.831734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d4415c0c-f621-4248-9645-4e1f00f559d5 tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 200 len: 1472 microversion: 2.1 time: 0.169591 Jul 14 11:04:31.838776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 386/777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:31 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:31.985136 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:31.986318 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:32.048534 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:32.049222 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:32.050715 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:32.053263 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:32.360493 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:32.376243 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0ab72cbf-efad-47f2-8b1e-5d399f44e9ff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1366 microversion: 2.1 time: 0.399554 Jul 14 11:04:32.377555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 392/778] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:31 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:32.856176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:32.857003 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] [instance: 85be01ce-dab6-4286-86ca-da4dc9fc30db] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:32.872430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:32.873309 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:32.875512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:32.877848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:32.905195 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] HTTP exception thrown: Instance 85be01ce-dab6-4286-86ca-da4dc9fc30db could not be found. Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Request method failure captured: Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db HTTP/1.1 Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fWm8rdesKS7FGBYlWE0IpV0ac5p4pcKu7FAkj5JGzoNJlpuiCCo0qPlkz_wu-ybDr3Oh40qZKWp6e-ZtEKbAJ49-kPrKEJlJqLAWJTNrtOVpRv-3sHwV-LLO5BcbJJLeavMLNz-5Lm_wELuZF9E2PCjRiAH7LyJjdrxTefT9OAd6U Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: ad57e412dc1e46c39f1121f3e4ca8ee9 Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1488142474 Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:04:32.907166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad57e412dc1e46c39f1121f3e4ca8ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-VolumesSnapshotTestJSON-1488142474 Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: ad57e412dc1e46c39f1121f3e4ca8ee9 Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1488142474 Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-VolumesSnapshotTestJSON-1488142474-project Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 75a9903b3597458f8f5af4d06cd07d4c Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-VolumesSnapshotTestJSON-1488142474-project Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 85be01ce-dab6-4286-86ca-da4dc9fc30db could not be found. Jul 14 11:04:32.909211 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '85be01ce-dab6-4286-86ca-da4dc9fc30db'} Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85be01ce-dab6-4286-86ca-da4dc9fc30db could not be found. Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:04:32.910533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85be01ce-dab6-4286-86ca-da4dc9fc30db could not be found. Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85be01ce-dab6-4286-86ca-da4dc9fc30db could not be found. Jul 14 11:04:32.912165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:04:32.914565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] Returning 404 to user: Instance 85be01ce-dab6-4286-86ca-da4dc9fc30db could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:04:32.915586 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-cde09e91-1876-4b6b-96fc-4e0f0d5234db tempest-VolumesSnapshotTestJSON-1488142474 tempest-VolumesSnapshotTestJSON-1488142474-project] 10.222.0.27 "GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db" status: 404 len: 111 microversion: 2.1 time: 0.064870 Jul 14 11:04:32.916985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 387/779] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:32 2022] GET /compute/v2.1/servers/85be01ce-dab6-4286-86ca-da4dc9fc30db => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:04:33.395083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:33.395707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:33.413275 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:33.416130 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:33.417511 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:33.417868 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:33.729857 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:33.741265 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-2cd074cd-5df6-467b-bf96-a002b58a3c49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1555 microversion: 2.1 time: 0.349402 Jul 14 11:04:33.742546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 393/780] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:33 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1555 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:33.766064 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:33.766712 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:33.778140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:33.778589 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:33.779378 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:33.779812 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:33.925161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-081e77ec-7a1e-4fb1-b3c8-10df0b3cca5f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164070 Jul 14 11:04:33.926219 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 388/781] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 11:04:33 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:35.478948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-24ffb0bd-4de8-4340-868c-bccb77f77169 req-afa4be3a-a067-4965-a5f3-e37340be9725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b0a3f5-054c-438a-a09a-510002782388", "tag": "63ae8504-e8d5-4423-bbf7-3c3704f1eaa0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:35.506041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-24ffb0bd-4de8-4340-868c-bccb77f77169 req-afa4be3a-a067-4965-a5f3-e37340be9725 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:35.510863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-24ffb0bd-4de8-4340-868c-bccb77f77169 req-afa4be3a-a067-4965-a5f3-e37340be9725 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:35.539580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-24ffb0bd-4de8-4340-868c-bccb77f77169 req-afa4be3a-a067-4965-a5f3-e37340be9725 service nova] Creating event network-changed:63ae8504-e8d5-4423-bbf7-3c3704f1eaa0 for instance 79b0a3f5-054c-438a-a09a-510002782388 on hv-cinder-84614 Jul 14 11:04:35.570309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-24ffb0bd-4de8-4340-868c-bccb77f77169 req-afa4be3a-a067-4965-a5f3-e37340be9725 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095150 Jul 14 11:04:35.571621 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 394/782] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:41.467200 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c842b68f-caef-4f23-9bf5-82fc5fb110e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Action: 'create', calling method: .version_select at 0x7f13d4335c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-688443031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfECWJgs7U/RPFCxIIiOtEEh9tTwBy5U5wBOA6b7x3rpJ3Z3xbILS8eLkAE5NGzbkMx/hE6odlcZKzVmJbFREDe6xF00E5Ruj+CG5zMollXzgBafkwzm2nKedRJG0KcxA=="}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:41.505380 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-c842b68f-caef-4f23-9bf5-82fc5fb110e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for project fea9c5d098d646b89213d35f737e2308. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:04:41.515435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-c842b68f-caef-4f23-9bf5-82fc5fb110e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for user 2e2b4b08c1b34a7f86996a806953ac1d and project fea9c5d098d646b89213d35f737e2308. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:04:41.584555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c842b68f-caef-4f23-9bf5-82fc5fb110e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.443700 Jul 14 11:04:41.587556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 389/783] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:04:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:46.638613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e5b33d59-dabb-4dcb-b064-fb1d03033733 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Action: 'create', calling method: .version_select at 0x7f13d42b6ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-747613914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+u/oB8TQdAkfLA/INTKptwxRWM8WEfWwUp1KfDTfoN/gl2xo5a1Ucu5hw8Rtaw/wspl9R7tNbl7nYZM4Dcv1/4mSivEdv7ycRek2getauq+LZvlzqPcZKQcVmFUzlEeQ=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:46.646489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=15 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.647541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=35 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.658347 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-e5b33d59-dabb-4dcb-b064-fb1d03033733 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Getting quotas for project bf4b0509ba7049e9bcccf1231113c8d9. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:04:46.665126 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-e5b33d59-dabb-4dcb-b064-fb1d03033733 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Getting quotas for user b594d2cb0f104dd1b8567928e6a15581 and project bf4b0509ba7049e9bcccf1231113c8d9. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:04:46.695678 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e5b33d59-dabb-4dcb-b064-fb1d03033733 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061417 Jul 14 11:04:46.696668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 395/784] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:04:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:46.833975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.839788 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-833641361", "imageRef": "ac56bf1a-9126-4761-8ec9-55ae17b0b1e9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-747613914", "networks": [{"uuid": "060f51cb-6609-47ce-903d-50f39c629da8"}]}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:46.900757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.network.neutron [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] validate_networks() for [('060f51cb-6609-47ce-903d-50f39c629da8', None, None, None, None, None)] {{(pid=133221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:04:47.516493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Flavor limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:04:47.517084 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Image limits 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:04:47.517711 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Flavor pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:04:47.518165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Image pref 0:0:0 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:04:47.518798 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.virt.hardware [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:04:47.528247 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:47.528685 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:47.529496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:47.529919 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:47.548603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Getting quotas for project bf4b0509ba7049e9bcccf1231113c8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:04:47.553033 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Getting quotas for user b594d2cb0f104dd1b8567928e6a15581 and project bf4b0509ba7049e9bcccf1231113c8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:04:47.564338 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Going to run 1 instances... {{(pid=133221) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:04:47.566579 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac56bf1a-9126-4761-8ec9-55ae17b0b1e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:04:47.627762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a885ed5c-b49a-41b7-bfb0-0d6afae5fc50 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794406 Jul 14 11:04:47.628548 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 390/785] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:04:47.638506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9e833ab8-b6b6-4c70-9581-8645e91e4801 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:47.639393 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9e833ab8-b6b6-4c70-9581-8645e91e4801 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:47.730981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9e833ab8-b6b6-4c70-9581-8645e91e4801 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:47.740196 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9e833ab8-b6b6-4c70-9581-8645e91e4801 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1257 microversion: 2.1 time: 0.105114 Jul 14 11:04:47.749819 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 396/786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:47 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1257 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:48.759658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:48.760666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:48.767903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:48.768544 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:48.769413 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:48.770112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:48.887938 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:48.902720 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3727c56c-e69e-4b3e-9b6a-a16b189ed51e tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1317 microversion: 2.1 time: 0.147536 Jul 14 11:04:48.905024 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 391/787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:48 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:49.922927 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:49.923943 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:49.948120 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:49.949006 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:49.949785 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:49.950277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:50.416824 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:50.428546 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7a3fc5ad-b8e2-4fc0-bb59-438e86e1bce9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.511193 Jul 14 11:04:50.431850 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 397/788] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:49 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:51.420855 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-68418b26-7ec2-44e2-8e38-63c4dfff9424 req-dd209019-64ec-43d7-99f0-de115184b329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:04:51.435059 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-68418b26-7ec2-44e2-8e38-63c4dfff9424 req-dd209019-64ec-43d7-99f0-de115184b329 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:51.435498 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-68418b26-7ec2-44e2-8e38-63c4dfff9424 req-dd209019-64ec-43d7-99f0-de115184b329 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:51.449566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:51.450129 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:51.469852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:51.471674 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:51.475450 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:51.476398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:51.481189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-68418b26-7ec2-44e2-8e38-63c4dfff9424 req-dd209019-64ec-43d7-99f0-de115184b329 service nova] Creating event network-changed:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:04:51.493935 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-68418b26-7ec2-44e2-8e38-63c4dfff9424 req-dd209019-64ec-43d7-99f0-de115184b329 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076644 Jul 14 11:04:51.498879 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 392/789] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:04:51.726472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:51.736964 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-189f27b4-80ae-4504-bacd-895a3b853709 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.291950 Jul 14 11:04:51.750923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 398/790] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:51 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:04:52.757913 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:52.759353 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:52.766823 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:52.767349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:52.768210 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:52.768646 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:52.929233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:52.937642 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4f2c33b9-7fd3-42e3-8d51-18bb21c93fe3 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.183932 Jul 14 11:04:52.938499 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 393/791] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:52 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:53.956341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:53.957333 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:53.965194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:53.965677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:53.966467 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:53.966903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:54.111545 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:54.119580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d0091859-f4b0-4fb0-9f16-be3d10722e78 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.167895 Jul 14 11:04:54.120192 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 399/792] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:53 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:55.137243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:55.137937 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:55.145535 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:55.145985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:55.146960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:55.147551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:55.299469 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:55.308045 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-cc2b1ad2-4ea0-4aa6-a72e-83ec2e110922 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.174669 Jul 14 11:04:55.309399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 394/793] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:55 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:56.332112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:56.333786 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:56.341084 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:56.341759 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:56.342789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:56.343356 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:56.516852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:56.531784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-832ed593-ee75-4b53-a2ff-04d1d16e8454 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.204856 Jul 14 11:04:56.532419 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 400/794] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:56 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:57.549921 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:57.550592 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:57.553723 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:57.558960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=10 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:57.561492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:57.562136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:57.563454 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:57.564418 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:57.734413 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:57.742656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-31923463-7787-471b-82d5-99d2c6567991 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.196517 Jul 14 11:04:57.743257 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 395/795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:57 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:58.760443 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:04:58.761076 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:04:58.763445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:58.769053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:58.769516 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:58.770285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:04:58.770730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:04:58.995162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:04:59.003242 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f9edee97-af41-4650-80b5-e19b0e03e0c5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.246718 Jul 14 11:04:59.011651 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 401/796] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:04:58 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:00.022260 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:00.022903 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:00.025422 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:00.031035 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:00.031489 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:00.032304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:00.032745 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:00.498323 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:00.506666 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2b2f03c3-98c6-4ada-8590-c4df70d34f32 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.490308 Jul 14 11:05:00.507260 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 396/797] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:00 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:01.360302 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-662253971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-688443031", "security_groups": [{"name": "tempest-secgroup-smoke-1894027251"}], "block_device_mapping_v2": [{"uuid": "bb25a2f7-a4d9-4f74-996b-82ffe7fa5182", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9328a65e-5214-4b81-8acd-9147149014ec"}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:01.478916 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] validate_networks() for [('9328a65e-5214-4b81-8acd-9147149014ec', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:05:01.522780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:01.523409 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:01.530001 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:01.530442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:01.531201 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:01.531629 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:01.730468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:01.738277 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4813df6d-121f-4ee2-9943-aaca3f5ab2c1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.219526 Jul 14 11:05:01.739041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 397/798] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:01 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:05:01.930724 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:05:01.931149 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:05:01.931626 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:05:01.932093 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:05:01.932478 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:05:01.941620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:01.942420 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:01.942863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:01.943305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:01.961790 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for project fea9c5d098d646b89213d35f737e2308. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:05:01.966066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for user 2e2b4b08c1b34a7f86996a806953ac1d and project fea9c5d098d646b89213d35f737e2308. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:05:02.024389 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:05:02.026481 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb25a2f7-a4d9-4f74-996b-82ffe7fa5182',volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:05:02.163055 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d901b867-7918-43be-8c55-a80a799480cb tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806686 Jul 14 11:05:02.163680 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 402/799] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:05:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:05:02.174110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-24e5380a-eaf4-4d25-a2a1-8481467b13da tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:02.174730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-24e5380a-eaf4-4d25-a2a1-8481467b13da tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:02.229715 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-24e5380a-eaf4-4d25-a2a1-8481467b13da tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:02.236430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-24e5380a-eaf4-4d25-a2a1-8481467b13da tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1093 microversion: 2.1 time: 0.066478 Jul 14 11:05:02.237022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 398/800] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:02 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:02.756693 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:02.757524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:02.763541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:02.764021 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:02.764776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:02.765232 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:02.905639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:02.914981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e39cbca6-ed1d-4125-a373-ee49530b7510 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.162938 Jul 14 11:05:02.915842 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 403/801] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:02 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:03.253049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:03.253673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:03.261056 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:03.261478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:03.262444 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:03.263093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:03.352341 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:03.360034 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0452bcb5-6957-4634-9667-d3042851775c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1209 microversion: 2.1 time: 0.110761 Jul 14 11:05:03.360696 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 399/802] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:03 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:05:03.932555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:03.933740 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:03.947142 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:03.947598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:03.948444 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:03.948887 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:04.215667 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:04.223671 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0aa5881c-2572-405b-aecc-14a914ad7cc5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.295214 Jul 14 11:05:04.224291 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 404/803] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:03 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:05:04.377633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:04.378233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:04.394986 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:04.395721 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:04.396756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:04.397156 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:04.598068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-a93b6138-9681-4036-89bf-77edac45523f req-1bbc2649-ec40-4b17-b31e-7ea5fc462397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "name": "network-vif-plugged", "status": "completed", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:04.610657 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-a93b6138-9681-4036-89bf-77edac45523f req-1bbc2649-ec40-4b17-b31e-7ea5fc462397 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:04.612191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-a93b6138-9681-4036-89bf-77edac45523f req-1bbc2649-ec40-4b17-b31e-7ea5fc462397 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:04.623815 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:04.627210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-a93b6138-9681-4036-89bf-77edac45523f req-1bbc2649-ec40-4b17-b31e-7ea5fc462397 service nova] Creating event network-vif-plugged:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:05:04.633018 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-a93b6138-9681-4036-89bf-77edac45523f req-1bbc2649-ec40-4b17-b31e-7ea5fc462397 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040683 Jul 14 11:05:04.633481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-55debd5d-24e6-4f47-9da9-0e1ae990cc17 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.259992 Jul 14 11:05:04.634375 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 405/804] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:05:04.634934 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 400/805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:04 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:04.724330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-34acfb14-983a-4646-91bd-431942c688b4 req-95591d64-5fcd-4455-b80a-21da08cef3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d1cdef-50ab-43b3-81eb-22803f438496", "tag": "c4aa472a-2608-44b3-abbd-d79763163f60"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:04.739556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-34acfb14-983a-4646-91bd-431942c688b4 req-95591d64-5fcd-4455-b80a-21da08cef3f1 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:04.740512 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-34acfb14-983a-4646-91bd-431942c688b4 req-95591d64-5fcd-4455-b80a-21da08cef3f1 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:04.755026 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-34acfb14-983a-4646-91bd-431942c688b4 req-95591d64-5fcd-4455-b80a-21da08cef3f1 service nova] Creating event network-changed:c4aa472a-2608-44b3-abbd-d79763163f60 for instance a9d1cdef-50ab-43b3-81eb-22803f438496 on hv-cinder-84614 Jul 14 11:05:04.761386 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-34acfb14-983a-4646-91bd-431942c688b4 req-95591d64-5fcd-4455-b80a-21da08cef3f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041783 Jul 14 11:05:04.762672 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 406/806] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:05.241346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:05.242057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:05.248579 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:05.249031 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:05.249808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:05.250241 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:05.460909 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:05.468638 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0765bac3-7cec-4439-960d-f5ad473e15f6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1357 microversion: 2.1 time: 0.231530 Jul 14 11:05:05.469168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 401/807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:05 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:05.652269 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:05.653059 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:05.659495 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:05.659974 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:05.661584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:05.662024 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:05.805633 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:05.817389 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5f1efe41-a4d7-443d-ba15-7b4da71d1059 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.169950 Jul 14 11:05:05.817966 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 407/808] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:05 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:06.491360 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:06.492464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:06.499232 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.499680 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.500525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.500927 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.722335 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:06.731226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-327a023b-19e8-4330-be1d-525e63410106 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1547 microversion: 2.1 time: 0.244499 Jul 14 11:05:06.731804 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 402/809] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:06 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1547 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:06.747689 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:06.748624 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:06.755834 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.756322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.757126 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.757566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.834527 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:06.835146 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:06.841633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.842083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.842860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.843294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.949422 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:06.957440 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3d4f8cbc-181e-4a3d-a0de-705247629c1a tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1547 microversion: 2.1 time: 0.213778 Jul 14 11:05:06.958041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 408/810] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:06 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1547 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:06.973195 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:06.976737 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:06.977504 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Searching by: {'deleted': False, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9'} {{(pid=133220) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 11:05:06.984322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.984781 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:06.985565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:06.986003 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:07.001057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:07.009208 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-063e2d85-d1cb-4855-a4ad-ee3ddc4f16d1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.178664 Jul 14 11:05:07.009768 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 403/811] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:06 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:07.077425 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.multi_cell_list [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=133220) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 11:05:07.198083 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-ecc80a55-1b90-4723-98b5-f405e5eaf758 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.228476 Jul 14 11:05:07.198586 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 409/812] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jul 14 11:05:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:05:07.210976 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:07.211594 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:07.218008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:07.218464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:07.219233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:07.219673 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:07.363856 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:07.376318 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-706c0ed8-1452-4ba9-a628-4f3d37f0fa46 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1547 microversion: 2.1 time: 0.170161 Jul 14 11:05:07.377069 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 404/813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:07 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:08.030274 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:08.031167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:08.040308 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:08.040760 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:08.041524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:08.041961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:08.181798 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:08.189836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8afa6fc6-5fb0-4d4a-b1a8-97652f445c55 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.166486 Jul 14 11:05:08.190409 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 410/814] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:08 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:08.946379 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90d9482e-1051-47c8-8d4a-943333e9de79"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:08.947539 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:08.954631 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:08.955018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:08.955796 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:08.956346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:09.208427 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:09.209017 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:09.216217 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:09.216677 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:09.217445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:09.217878 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:09.220751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9afa8a10-1987-43fd-b7c4-6d4d43fc33b5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278727 Jul 14 11:05:09.221397 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 405/815] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:05:08 2022] POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:09.534879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:09.543452 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e448f880-adae-47e5-a4d8-72b351ac53dc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.340267 Jul 14 11:05:09.544192 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 411/816] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:09 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:10.175964 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:10.176740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:10.183355 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.183809 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.184608 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.185049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.208801 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a293f859-0d28-44c5-b692-6d03468eb433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/ips" status: 200 len: 149 microversion: 2.1 time: 0.040849 Jul 14 11:05:10.209284 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 406/817] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:05:10 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:10.222473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edf3665-97fd-4f01-8509-abf206b32e32"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:10.224090 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:10.230939 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.231375 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.232168 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.232596 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.314050 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Invalid volume: volume 9edf3665-97fd-4f01-8509-abf206b32e32 is already attached to instances: d73519f9-0e9d-41ab-ba9b-619cf97f8822 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: POST /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/os-volume_attachments HTTP/1.1 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 74 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:05:10.316030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {"volumeAttachment": {"volumeId": "9edf3665-97fd-4f01-8509-abf206b32e32"}} Jul 14 11:05:10.317764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Invalid volume: volume 9edf3665-97fd-4f01-8509-abf206b32e32 is already attached to instances: d73519f9-0e9d-41ab-ba9b-619cf97f8822 Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'server_id': '79b0a3f5-054c-438a-a09a-510002782388', 'body': {'volumeAttachment': {'volumeId': '9edf3665-97fd-4f01-8509-abf206b32e32'}}} Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9edf3665-97fd-4f01-8509-abf206b32e32 is already attached to instances: d73519f9-0e9d-41ab-ba9b-619cf97f8822 Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:10.318767 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9edf3665-97fd-4f01-8509-abf206b32e32 is already attached to instances: d73519f9-0e9d-41ab-ba9b-619cf97f8822 Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:10.320668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9edf3665-97fd-4f01-8509-abf206b32e32 is already attached to instances: d73519f9-0e9d-41ab-ba9b-619cf97f8822 Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 400 to user: Invalid volume: volume 9edf3665-97fd-4f01-8509-abf206b32e32 is already attached to instances: d73519f9-0e9d-41ab-ba9b-619cf97f8822 {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-21b56b34-44dc-4d9a-8a43-d53f0457889a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102264 Jul 14 11:05:10.322613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 412/818] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:05:10 2022] POST /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:05:10.328885 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:10.329387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:10.336464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.336969 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.337878 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.338442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.363797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:05:10.366839 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:10.460435 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2941c0a0-9910-4360-ac6c-8747ef9acf63 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 204 len: 0 microversion: 2.1 time: 0.135209 Jul 14 11:05:10.461146 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 407/819] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:05:10 2022] DELETE /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:05:10.472076 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:10.472701 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:10.479444 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.479912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.480693 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.481134 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.562026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:10.562836 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:10.569296 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.569814 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.570757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:10.571243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:10.668179 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:10.677587 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-08a9546e-5c57-4915-a0c0-7813c6a9248c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1680 microversion: 2.1 time: 0.210341 Jul 14 11:05:10.678169 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 413/820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:10 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:10.736550 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:10.744966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f9dfe32e-49f9-493e-abd2-63b3ccf74c48 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.187240 Jul 14 11:05:10.745537 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 408/821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:10 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:11.700405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:11.701430 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:11.711135 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:11.711588 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:11.712407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:11.712849 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:11.761896 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:11.762491 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:11.769465 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:11.769975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:11.770790 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:11.771236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:11.894179 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:11.902230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-62c7e5f8-474c-4b49-b4d9-d302c3bf7ecd tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1680 microversion: 2.1 time: 0.208434 Jul 14 11:05:11.902791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 414/822] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:11 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:11.936449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:11.944390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-70c2831f-f8fe-407e-868c-5be60b6aac02 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.186346 Jul 14 11:05:11.944962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 409/823] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:11 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:12.920670 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:12.921462 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:12.923630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.930197 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:12.930724 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:12.931562 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:12.932043 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:12.937878 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=100 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.961415 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:12.962058 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:12.964145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.972259 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:12.972848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:12.973961 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:12.974464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:13.042523 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:13.050201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-794afdbf-755c-4162-a6ba-77b2abdd6066 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 200 len: 1612 microversion: 2.1 time: 0.133713 Jul 14 11:05:13.050763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 415/824] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:12 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 1612 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:13.180083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:13.188702 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-95e3bc29-6b31-4cee-8d76-42b4a4d37f11 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.231222 Jul 14 11:05:13.189505 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 410/825] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:12 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:05:13.350104 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-c2779f09-a48a-4690-b0ab-02ff619afd40 req-fa584aaa-782c-4aa3-8746-35e2f749cd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b0a3f5-054c-438a-a09a-510002782388", "name": "network-vif-deleted", "tag": "63ae8504-e8d5-4423-bbf7-3c3704f1eaa0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:13.363091 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-c2779f09-a48a-4690-b0ab-02ff619afd40 req-fa584aaa-782c-4aa3-8746-35e2f749cd19 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:13.363925 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-c2779f09-a48a-4690-b0ab-02ff619afd40 req-fa584aaa-782c-4aa3-8746-35e2f749cd19 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:13.377817 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-c2779f09-a48a-4690-b0ab-02ff619afd40 req-fa584aaa-782c-4aa3-8746-35e2f749cd19 service nova] Creating event network-vif-deleted:63ae8504-e8d5-4423-bbf7-3c3704f1eaa0 for instance 79b0a3f5-054c-438a-a09a-510002782388 on hv-cinder-84614 Jul 14 11:05:13.383539 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-c2779f09-a48a-4690-b0ab-02ff619afd40 req-fa584aaa-782c-4aa3-8746-35e2f749cd19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037528 Jul 14 11:05:13.384635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 416/826] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:14.068285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:14.068916 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:14.075782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:14.076268 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:14.077070 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:14.077478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:14.091400 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 HTTP/1.1 Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:05:14.093089 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:05:14.094602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '79b0a3f5-054c-438a-a09a-510002782388'} Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:05:14.095390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:05:14.096748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:05:14.098980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:05:14.098980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7268198e-8427-4b00-96d5-c48526e4e9f3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 404 len: 111 microversion: 2.1 time: 0.030808 Jul 14 11:05:14.098980 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 411/827] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:14 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:05:14.105234 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fe4afc52-e547-4a94-b634-64a3f7288b6c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '.version_select at 0x7f13d42d4ee0>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:14.125166 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fe4afc52-e547-4a94-b634-64a3f7288b6c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657092281" status: 202 len: 0 microversion: 2.1 time: 0.024635 Jul 14 11:05:14.125734 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 417/828] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 11:05:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657092281 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:05:14.206846 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:14.207857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:14.215445 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:14.216001 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:14.217004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:14.217659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:14.365566 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:14.376019 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-13ab8a47-afb1-4fa1-bc67-46731adfc7b5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.173168 Jul 14 11:05:14.376615 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 412/829] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:14 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:15.052389 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:15.053321 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:15.059730 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.060565 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.061513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.062092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.144193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lazy-loading 'services' on Instance uuid d73519f9-0e9d-41ab-ba9b-619cf97f8822 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:05:15.219170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-32d0978b-8fe0-44af-a231-a5ea9737c4fa tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments/9edf3665-97fd-4f01-8509-abf206b32e32" status: 202 len: 0 microversion: 2.1 time: 0.171555 Jul 14 11:05:15.219735 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 418/830] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:05:15 2022] DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments/9edf3665-97fd-4f01-8509-abf206b32e32 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:05:15.228368 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:15.229404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:15.236155 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.236607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.237375 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.237817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.267786 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3c57debb-7102-4293-ae94-f56de2790db2 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Jul 14 11:05:15.268450 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 413/831] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:05:15 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:15.394572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:15.395769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:15.402889 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.403423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.404254 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.404694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.553757 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:15.563686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-489d526e-631c-41e9-a7f1-8f870b90ffa4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.173120 Jul 14 11:05:15.564580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 419/832] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:15 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:15.807844 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:15.808519 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:15.817265 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.817876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.818688 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:15.819120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:15.986740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:15.998413 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2fc9a212-2ed8-4c14-be61-ecae3343d630 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1593 microversion: 2.1 time: 0.194871 Jul 14 11:05:15.998899 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 414/833] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:15 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1593 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:16.281108 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:16.281753 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:16.290220 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.290655 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.291459 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.291909 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.326912 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3f30ea16-9490-4ec3-9a1f-9997dee6ae49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050953 Jul 14 11:05:16.327503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 420/834] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:05:16 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:05:16.387381 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:16.387944 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:16.394761 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.395381 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.396203 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.396642 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.424876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:05:16.511022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b0cabae6-9d9b-4535-9955-45dd032b17a3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 204 len: 0 microversion: 2.1 time: 0.127826 Jul 14 11:05:16.512423 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 415/835] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:05:16 2022] DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:05:16.524404 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:16.526754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:16.537053 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.538598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.539772 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.540710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.588881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:16.590437 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:16.598595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.600408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:16.601402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:16.602020 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:17.018273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:17.089853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:17.097340 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:17.097738 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ef6e03a5-0003-4e54-bf10-99c3d4d17d45 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.519107 Jul 14 11:05:17.106689 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 416/836] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:16 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:17.106689 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-2dcf26ee-e233-45a0-a72c-f4964b5d8141 req-97c41112-5219-4683-9582-ed5be68d3e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d1cdef-50ab-43b3-81eb-22803f438496", "name": "network-vif-plugged", "status": "completed", "tag": "c4aa472a-2608-44b3-abbd-d79763163f60"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:17.106993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-af50f223-c348-43e2-aafe-af2081f23433 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1681 microversion: 2.1 time: 0.588866 Jul 14 11:05:17.106993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 421/837] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:16 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1681 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:17.111387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-2dcf26ee-e233-45a0-a72c-f4964b5d8141 req-97c41112-5219-4683-9582-ed5be68d3e08 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:17.111794 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-2dcf26ee-e233-45a0-a72c-f4964b5d8141 req-97c41112-5219-4683-9582-ed5be68d3e08 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:17.123758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-2dcf26ee-e233-45a0-a72c-f4964b5d8141 req-97c41112-5219-4683-9582-ed5be68d3e08 service nova] Creating event network-vif-plugged:c4aa472a-2608-44b3-abbd-d79763163f60 for instance a9d1cdef-50ab-43b3-81eb-22803f438496 on hv-cinder-84614 Jul 14 11:05:17.128780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-2dcf26ee-e233-45a0-a72c-f4964b5d8141 req-97c41112-5219-4683-9582-ed5be68d3e08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028792 Jul 14 11:05:17.129955 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 417/838] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:18.114957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:18.115527 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:18.118357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:18.123994 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:18.124914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:18.125351 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:18.125458 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:18.126143 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:18.126754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:18.132016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:18.132538 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:18.133660 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:18.134124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:18.559486 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:18.568496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-96f69759-e5fe-434d-b0fc-c1e97ff64934 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1265 microversion: 2.1 time: 0.457579 Jul 14 11:05:18.569208 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 422/839] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:18 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1265 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:18.585811 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:18.593790 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e9d1d930-3be9-412e-b7c3-4a88c1c2815b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1681 microversion: 2.1 time: 0.474870 Jul 14 11:05:18.594585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 418/840] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:18 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1681 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:18.907725 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-7b7415bc-6520-4a59-ae5a-9cb9b5eed337 req-da63fd3f-2e98-4bdd-9052-7a8fc28d66ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:18.920805 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-7b7415bc-6520-4a59-ae5a-9cb9b5eed337 req-da63fd3f-2e98-4bdd-9052-7a8fc28d66ed service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:18.921258 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-7b7415bc-6520-4a59-ae5a-9cb9b5eed337 req-da63fd3f-2e98-4bdd-9052-7a8fc28d66ed service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:18.934235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-7b7415bc-6520-4a59-ae5a-9cb9b5eed337 req-da63fd3f-2e98-4bdd-9052-7a8fc28d66ed service nova] Creating event network-changed:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:05:18.940624 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-7b7415bc-6520-4a59-ae5a-9cb9b5eed337 req-da63fd3f-2e98-4bdd-9052-7a8fc28d66ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036200 Jul 14 11:05:18.941301 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 423/841] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:19.586391 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:19.588075 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:19.595480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:19.596431 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:19.596817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:19.597255 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:19.617002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:19.619047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:19.631785 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:19.633077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:19.637680 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:19.638106 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:19.890830 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:19.899967 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a86d4f27-8582-4ea5-8adb-4ed200ae4192 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 200 len: 1613 microversion: 2.1 time: 0.289954 Jul 14 11:05:19.900650 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 424/842] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:19 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 1613 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:20.117887 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:20.128647 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e8cc746f-8eee-4e3b-ac22-f44029072af7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1451 microversion: 2.1 time: 0.546232 Jul 14 11:05:20.129533 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 419/843] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:19 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1451 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:20.145801 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:20.146418 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:20.152641 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:20.153085 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:20.153866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:20.154298 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:20.400326 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:20.408277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-cb7933f6-35b7-401e-9ec5-a8e225d22fe1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1451 microversion: 2.1 time: 0.266376 Jul 14 11:05:20.409015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 425/844] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:20 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1451 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:20.835751 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-603059993"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:20.836392 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:20.852141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:20.854284 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:20.855235 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:20.855740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:20.920060 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:20.921310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:20.930810 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:20.931248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:20.932055 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:20.932681 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:20.950863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 HTTP/1.1 Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:05:20.952852 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:05:20.954423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'd73519f9-0e9d-41ab-ba9b-619cf97f8822'} Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:05:20.955346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:05:20.956770 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:05:20.959348 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:05:20.960370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a5a99b3a-db48-4d73-8573-2d8aa46b508f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 404 len: 111 microversion: 2.1 time: 0.046063 Jul 14 11:05:20.961115 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 426/845] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:20 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:05:20.969248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-613759c5-648d-4a46-bf4a-0b3926f14c06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '.version_select at 0x7f13d433ed30>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:20.994281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-613759c5-648d-4a46-bf4a-0b3926f14c06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-600895686" status: 202 len: 0 microversion: 2.1 time: 0.028767 Jul 14 11:05:20.994866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 427/846] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 11:05:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-600895686 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:05:20.999437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-59ceb017-8779-4c66-a048-d6600b5f3a9d req-9e1d4ea6-6b27-452d-b521-1ee3be6daf20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73519f9-0e9d-41ab-ba9b-619cf97f8822", "name": "network-vif-deleted", "tag": "11644f03-c090-4846-901d-f5aed3780ac3"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:21.011547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-59ceb017-8779-4c66-a048-d6600b5f3a9d req-9e1d4ea6-6b27-452d-b521-1ee3be6daf20 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:21.012259 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-59ceb017-8779-4c66-a048-d6600b5f3a9d req-9e1d4ea6-6b27-452d-b521-1ee3be6daf20 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:21.030131 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-59ceb017-8779-4c66-a048-d6600b5f3a9d req-9e1d4ea6-6b27-452d-b521-1ee3be6daf20 service nova] Creating event network-vif-deleted:11644f03-c090-4846-901d-f5aed3780ac3 for instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 on hv-cinder-84614 Jul 14 11:05:21.035754 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-59ceb017-8779-4c66-a048-d6600b5f3a9d req-9e1d4ea6-6b27-452d-b521-1ee3be6daf20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039314 Jul 14 11:05:21.036420 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 428/847] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:21.135333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.network.security_group_api [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Adding security group 2e6e24de-7cf4-40a7-9317-dd59bb6b0926 to port 2c07bf24-3abb-40af-9cc0-421d1cc3783a Jul 14 11:05:21.688492 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5f38bcb4-476d-45d2-aa81-652e5b96db54 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: .version_select at 0x7f13d433bdc0>, body: {"keypair": {"name": "tempest-keypair-758151164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9yazHGJjd9EM6PK3IxTn0JfATtgaSvpBNPTs03jEYtNhrn53JMO28i0PI6FHiXboHPpAXPyiduZy8J+ZJILmWi8bdJim9bX9WXM452Xg00Cl/LMyQV+kqxDpabB8t5Q=="}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:21.706262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-5f38bcb4-476d-45d2-aa81-652e5b96db54 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:05:21.711743 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-5f38bcb4-476d-45d2-aa81-652e5b96db54 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:05:21.738657 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5f38bcb4-476d-45d2-aa81-652e5b96db54 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054675 Jul 14 11:05:21.740058 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 429/848] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:05:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:05:21.787380 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3c8ca072-2a59-4ad0-9a02-e6aa38a3702f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.956158 Jul 14 11:05:21.793717 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 420/849] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:05:20 2022] POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/action => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:05:21.799567 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:21.802881 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:21.821487 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:21.821943 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:21.824267 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:21.824752 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:22.090629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:22.102283 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e9176c29-dd01-4e51-b7d3-03400608fea9 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1758 microversion: 2.1 time: 0.306962 Jul 14 11:05:22.103501 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 430/850] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:21 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1758 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:23.062957 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-f12a4045-7a30-4974-8969-a4f0b677611a req-58d500c6-12f4-446a-b9d3-bb2ce78ab949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:23.071651 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-f12a4045-7a30-4974-8969-a4f0b677611a req-58d500c6-12f4-446a-b9d3-bb2ce78ab949 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:23.072143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-f12a4045-7a30-4974-8969-a4f0b677611a req-58d500c6-12f4-446a-b9d3-bb2ce78ab949 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:23.083628 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-f12a4045-7a30-4974-8969-a4f0b677611a req-58d500c6-12f4-446a-b9d3-bb2ce78ab949 service nova] Creating event network-changed:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:05:23.088999 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-f12a4045-7a30-4974-8969-a4f0b677611a req-58d500c6-12f4-446a-b9d3-bb2ce78ab949 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030325 Jul 14 11:05:23.089858 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 421/851] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:24.332405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1404763087", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42115c3-3c7a-438d-89c4-e806c3160582"}], "security_groups": [{"name": "tempest-securitygroup--1265616248"}], "key_name": "tempest-keypair-758151164", "user_data": "}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:24.434889 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] validate_networks() for [('a42115c3-3c7a-438d-89c4-e806c3160582', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:05:24.832842 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:05:24.833266 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:05:24.833769 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:05:24.834173 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:05:24.834582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:05:24.843758 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:24.844236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:24.845040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:24.845480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:24.862125 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:05:24.866114 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:05:24.879992 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:05:24.883463 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:05:24.952716 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3a587c36-f0f8-41da-a8ef-85b263254163 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624692 Jul 14 11:05:24.953378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 431/852] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:05:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:05:24.964974 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-756a1762-445d-470b-8f1e-b2d0e4486e99 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:24.965678 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-756a1762-445d-470b-8f1e-b2d0e4486e99 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:25.023135 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-756a1762-445d-470b-8f1e-b2d0e4486e99 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:25.030311 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-756a1762-445d-470b-8f1e-b2d0e4486e99 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1241 microversion: 2.1 time: 0.070050 Jul 14 11:05:25.031046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 422/853] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:24 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:25.104619 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-1c73c827-3f37-4b1e-8daf-b9ccef579467 req-ff221019-dd66-47e0-b1d9-d29c217a571c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d1cdef-50ab-43b3-81eb-22803f438496", "tag": "c4aa472a-2608-44b3-abbd-d79763163f60"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:25.115140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1c73c827-3f37-4b1e-8daf-b9ccef579467 req-ff221019-dd66-47e0-b1d9-d29c217a571c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:25.115570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1c73c827-3f37-4b1e-8daf-b9ccef579467 req-ff221019-dd66-47e0-b1d9-d29c217a571c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:25.126257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-1c73c827-3f37-4b1e-8daf-b9ccef579467 req-ff221019-dd66-47e0-b1d9-d29c217a571c service nova] Creating event network-changed:c4aa472a-2608-44b3-abbd-d79763163f60 for instance a9d1cdef-50ab-43b3-81eb-22803f438496 on hv-cinder-84614 Jul 14 11:05:25.131342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-1c73c827-3f37-4b1e-8daf-b9ccef579467 req-ff221019-dd66-47e0-b1d9-d29c217a571c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030330 Jul 14 11:05:25.132207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 432/854] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:26.049643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:26.051155 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:26.058755 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:26.059466 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:26.060250 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:26.060974 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:26.143048 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:26.150798 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-83f2a1d4-76cb-4cb4-a776-9e3b89a1fbcc tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1311 microversion: 2.1 time: 0.106759 Jul 14 11:05:26.151343 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 423/855] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:26 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:27.169819 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:27.170498 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:27.177295 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:27.177758 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:27.178851 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:27.179287 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:27.391380 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:27.400174 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-0fbac282-64e5-40b6-821b-6e2913aee05c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.235100 Jul 14 11:05:27.400879 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 433/856] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:27 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:27.523257 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-21d01a55-cc7f-440c-8e9e-d3d1fc8ef162 req-2a26a305-e5b5-49bb-a10b-0a3c83f15a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00855c24-ab40-49a7-8a4c-52c2d6486cd2", "tag": "f59d83db-92f9-4b4b-bb4b-63c49f876926"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:27.533594 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-21d01a55-cc7f-440c-8e9e-d3d1fc8ef162 req-2a26a305-e5b5-49bb-a10b-0a3c83f15a19 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:27.534019 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-21d01a55-cc7f-440c-8e9e-d3d1fc8ef162 req-2a26a305-e5b5-49bb-a10b-0a3c83f15a19 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:27.548083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-21d01a55-cc7f-440c-8e9e-d3d1fc8ef162 req-2a26a305-e5b5-49bb-a10b-0a3c83f15a19 service nova] Creating event network-changed:f59d83db-92f9-4b4b-bb4b-63c49f876926 for instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 on hv-cinder-84614 Jul 14 11:05:27.553386 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-21d01a55-cc7f-440c-8e9e-d3d1fc8ef162 req-2a26a305-e5b5-49bb-a10b-0a3c83f15a19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034044 Jul 14 11:05:27.554264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 424/857] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:28.422218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:28.423193 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:28.434631 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:28.435333 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:28.436643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:28.437358 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:28.574033 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:28.581707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9431e8b9-67be-4680-9c19-10f95ab84dff tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.166041 Jul 14 11:05:28.582276 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 434/858] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:28 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:29.605494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:29.606550 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:29.616904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:29.617349 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:29.618148 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:29.618579 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:29.622715 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:29.750636 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:29.758746 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-34c04334-47cd-4f7a-9fda-ec35e1238eee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.161448 Jul 14 11:05:29.759339 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 425/859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:29 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:30.776084 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:30.776741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:30.783554 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:30.784034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:30.784809 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:30.785377 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:30.928594 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:30.936285 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-826a7155-4728-4713-85e4-956d2190eae5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.164201 Jul 14 11:05:30.936855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 435/860] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:30 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:31.953577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:31.954191 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:31.956600 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:31.962607 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:31.963057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:31.963857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:31.964317 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:32.099122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:32.112894 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-283a1a15-0008-4ceb-96f7-c4ff456c0799 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.163212 Jul 14 11:05:32.113459 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 426/861] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:31 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:32.793705 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-88172db0-ce73-4f5f-97c9-6b6c088bc01b req-91d52b26-d008-4e55-8d65-129e41cefa78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00855c24-ab40-49a7-8a4c-52c2d6486cd2", "name": "network-vif-plugged", "status": "completed", "tag": "f59d83db-92f9-4b4b-bb4b-63c49f876926"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:32.802979 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-88172db0-ce73-4f5f-97c9-6b6c088bc01b req-91d52b26-d008-4e55-8d65-129e41cefa78 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:32.803418 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-88172db0-ce73-4f5f-97c9-6b6c088bc01b req-91d52b26-d008-4e55-8d65-129e41cefa78 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:32.814973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-88172db0-ce73-4f5f-97c9-6b6c088bc01b req-91d52b26-d008-4e55-8d65-129e41cefa78 service nova] Creating event network-vif-plugged:f59d83db-92f9-4b4b-bb4b-63c49f876926 for instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 on hv-cinder-84614 Jul 14 11:05:32.819859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-88172db0-ce73-4f5f-97c9-6b6c088bc01b req-91d52b26-d008-4e55-8d65-129e41cefa78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030387 Jul 14 11:05:32.820636 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 436/862] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:33.134263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:33.135275 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:33.146304 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:33.146782 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:33.147554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:33.148027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:33.292573 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:33.300672 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a9e20c41-42ca-4ff2-ba76-8713369ccbe3 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.172997 Jul 14 11:05:33.301263 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 427/863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:33 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:34.323940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:34.325151 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:34.335368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:34.335810 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:34.336605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:34.337038 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:34.479361 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:34.486924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9ac7db75-146e-4626-bfab-40405489e18b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1367 microversion: 2.1 time: 0.171140 Jul 14 11:05:34.487480 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 437/864] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:34 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:35.508709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:35.509495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:35.511968 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:35.518120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:35.518567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:35.519325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:35.519756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:35.654120 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:35.662074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c3ecde7a-5079-4359-aaa2-527deda3f7cb tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1557 microversion: 2.1 time: 0.160110 Jul 14 11:05:35.662979 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 428/865] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:35 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:35.678940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:35.679522 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:35.681484 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:35.682112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=10 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:35.688214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:35.688658 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:35.689416 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:35.689845 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:35.781691 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b3cd9a80-938c-4f98-88d3-13931dedf270 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106574 Jul 14 11:05:35.782286 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 438/866] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 11:05:35 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:37.036649 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-7d8701e7-f961-4082-90f6-7add67d9b407 req-5c9d8877-63db-4e80-ac8d-6bbe2f97a72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00855c24-ab40-49a7-8a4c-52c2d6486cd2", "tag": "f59d83db-92f9-4b4b-bb4b-63c49f876926"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:37.045681 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-7d8701e7-f961-4082-90f6-7add67d9b407 req-5c9d8877-63db-4e80-ac8d-6bbe2f97a72d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:37.046130 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-7d8701e7-f961-4082-90f6-7add67d9b407 req-5c9d8877-63db-4e80-ac8d-6bbe2f97a72d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:37.056982 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-7d8701e7-f961-4082-90f6-7add67d9b407 req-5c9d8877-63db-4e80-ac8d-6bbe2f97a72d service nova] Creating event network-changed:f59d83db-92f9-4b4b-bb4b-63c49f876926 for instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 on hv-cinder-84614 Jul 14 11:05:37.062073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-7d8701e7-f961-4082-90f6-7add67d9b407 req-5c9d8877-63db-4e80-ac8d-6bbe2f97a72d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029097 Jul 14 11:05:37.062633 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 429/867] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:05:44.499556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:05:44.501137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:44.510435 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:44.510878 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:44.511638 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:44.512100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:44.514648 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:44.599649 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-19f881fd-6a0f-4451-9415-f0c5d1494dbd tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.107101 Jul 14 11:05:44.600303 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 439/868] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:05:44 2022] POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:05:44.611232 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:44.611868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:44.619463 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:44.620225 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:44.621264 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:44.621443 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:44.868354 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:44.876742 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f416f0f6-79ca-40a9-a0ce-c5be77c10905 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1750 microversion: 2.1 time: 0.270337 Jul 14 11:05:44.877462 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 430/869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:44 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:45.896164 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:45.896816 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:45.903500 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:45.903971 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:45.904732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:45.905159 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:46.053598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:46.062040 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-98063354-ac24-4eb2-a6a4-c4fdde982f4d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.171035 Jul 14 11:05:46.062600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 440/870] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:45 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:47.080805 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:47.081571 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:47.089698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:47.090145 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:47.090920 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:47.091344 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:47.252453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:47.261091 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-fec884b7-d525-4003-b4b4-c6d3ab9cfbf5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.185235 Jul 14 11:05:47.261640 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 431/871] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:47 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:48.279013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:48.279665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:48.282270 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:48.288882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:48.289387 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:48.290263 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:48.290708 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:48.441169 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:48.449336 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9e5721c4-3de4-424a-8b36-e8bdd1601d04 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.174529 Jul 14 11:05:48.449944 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 441/872] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:48 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:49.470653 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:49.471495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:49.482728 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:49.483432 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:49.484705 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:49.485387 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:49.638085 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:49.646545 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-34482d9e-95fb-441e-812a-66de02797ff7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.182551 Jul 14 11:05:49.647427 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 432/873] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:49 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:50.670331 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:50.670953 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:50.677800 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:50.678259 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:50.679288 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:50.679823 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:50.843903 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:50.855668 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-1ab5774e-1520-4da5-92fb-07360bab8d3b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.189412 Jul 14 11:05:50.856289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 442/874] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:50 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:51.876840 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:51.877837 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:51.888209 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:51.888646 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:51.889406 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:51.889833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:52.040762 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:52.049664 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e966cfd3-b79e-4aac-adcb-1e4456184725 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.179258 Jul 14 11:05:52.050234 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 433/875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:51 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:53.070994 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:53.072066 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:53.083399 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:53.084201 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:53.085458 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:53.086174 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:53.236430 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:53.247921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e829efee-2abe-4499-a6eb-8b61c0960b79 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.183752 Jul 14 11:05:53.248476 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 443/876] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:53 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:54.270111 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:54.270973 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:54.282313 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:54.283065 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:54.284395 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:54.285132 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:54.450132 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:54.461026 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c276dc1f-6492-4748-beb9-aa13f551e584 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.197707 Jul 14 11:05:54.461602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 434/877] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:54 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:55.482785 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:55.483757 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:55.494888 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:55.495630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:55.497092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:55.497525 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:55.648933 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:55.657892 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-09ccd602-e580-4f1a-8c6f-bda5dae20e7b tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.181914 Jul 14 11:05:55.658446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 444/878] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:55 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:56.678957 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:56.679637 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:56.687097 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:56.687547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:56.688389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:56.688824 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:56.849401 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:56.862159 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6379119c-9ae9-4441-9407-233cb6de55da tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.186891 Jul 14 11:05:56.863040 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 435/879] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:56 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:57.887092 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:57.887791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:57.894999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:57.895445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:57.896240 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:57.896665 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:58.049180 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:58.064643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-7af06f66-887c-4dcd-a7da-4636f04d6689 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.183930 Jul 14 11:05:58.065403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 445/880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:57 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:05:59.089468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:05:59.090458 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:05:59.097162 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:59.097614 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:59.098383 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:05:59.098820 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:05:59.252491 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:05:59.263117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b4519153-f7ff-4317-9255-5f56777423a4 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.180089 Jul 14 11:05:59.263703 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 436/881] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:05:59 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:00.283996 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:00.284632 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:00.294167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:00.294611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:00.295368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:00.295797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:00.458472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:00.469559 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-25e8135e-f414-43d9-a0be-47a409ce063d tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.191860 Jul 14 11:06:00.470403 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 446/882] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:00 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:01.490810 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:01.491854 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:01.502884 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:01.503624 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:01.504938 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:01.505657 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:01.510030 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=67 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:01.659595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:01.671585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d1612896-52e6-451f-8a70-5e24435a8239 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.187301 Jul 14 11:06:01.672170 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 437/883] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:01 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:02.693456 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:02.694433 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:02.704741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:02.705469 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:02.706733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:02.707453 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:02.886987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:02.895727 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-41224e8e-d801-46b2-a80f-5175825af1a5 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.209054 Jul 14 11:06:02.896324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 447/884] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:02 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:03.917598 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:03.918603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:03.920916 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=24 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:03.926588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:03.927027 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:03.927795 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:03.928256 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:04.081288 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:04.089454 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2572f07e-e5c6-47bb-94c0-3ff31ddd59e6 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.178843 Jul 14 11:06:04.090022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 438/885] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:03 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:05.110993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:05.112077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:05.122706 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:05.123156 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:05.123967 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:05.124410 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:05.276334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:05.290460 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-697fb1af-0217-46ef-b9b6-ed0e4576cffb tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.185845 Jul 14 11:06:05.291359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 448/886] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:05 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:06.313602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:06.314496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:06.325403 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:06.325849 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:06.326621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:06.327053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:06.476173 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:06.484372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5effcb15-48a8-4a85-91e3-d50dc00e2a6c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1755 microversion: 2.1 time: 0.177778 Jul 14 11:06:06.484940 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 439/887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:06 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:07.506593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:07.507584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:07.516391 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:07.516836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:07.517602 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:07.518037 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:07.671588 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:07.680127 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-9c7ba86d-4df7-43c6-82fe-78220041e255 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1758 microversion: 2.1 time: 0.180172 Jul 14 11:06:07.680669 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 449/888] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:07 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:13.014420 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:13.015090 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:13.024391 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:13.024993 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:13.026009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:13.026591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:13.060166 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8fcad9c6-9402-44cb-8041-915a670708db tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/ips" status: 200 len: 150 microversion: 2.1 time: 0.050577 Jul 14 11:06:13.060977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 440/889] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:06:13 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:14.394694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1235d2a-5118-401d-9d9d-68a03929bfa0"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:14.395763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:14.403170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:14.403807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:14.404613 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:14.405046 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:14.633836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:14.659496 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-17efc589-a842-4760-90f2-7265ebe0675f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268610 Jul 14 11:06:14.660148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 450/890] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:06:14 2022] POST /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:21.177847 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1235d2a-5118-401d-9d9d-68a03929bfa0"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:21.178913 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:21.185880 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:21.186320 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:21.187073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:21.187506 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:21.266977 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Invalid volume: volume b1235d2a-5118-401d-9d9d-68a03929bfa0 is already attached to instances: 00855c24-ab40-49a7-8a4c-52c2d6486cd2 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: POST /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments HTTP/1.1 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 74 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:06:21.268733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {"volumeAttachment": {"volumeId": "b1235d2a-5118-401d-9d9d-68a03929bfa0"}} Jul 14 11:06:21.270442 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Invalid volume: volume b1235d2a-5118-401d-9d9d-68a03929bfa0 is already attached to instances: 00855c24-ab40-49a7-8a4c-52c2d6486cd2 Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'server_id': '00855c24-ab40-49a7-8a4c-52c2d6486cd2', 'body': {'volumeAttachment': {'volumeId': 'b1235d2a-5118-401d-9d9d-68a03929bfa0'}}} Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b1235d2a-5118-401d-9d9d-68a03929bfa0 is already attached to instances: 00855c24-ab40-49a7-8a4c-52c2d6486cd2 Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:21.271493 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b1235d2a-5118-401d-9d9d-68a03929bfa0 is already attached to instances: 00855c24-ab40-49a7-8a4c-52c2d6486cd2 Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:21.272831 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b1235d2a-5118-401d-9d9d-68a03929bfa0 is already attached to instances: 00855c24-ab40-49a7-8a4c-52c2d6486cd2 Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 400 to user: Invalid volume: volume b1235d2a-5118-401d-9d9d-68a03929bfa0 is already attached to instances: 00855c24-ab40-49a7-8a4c-52c2d6486cd2 {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-75ad4ca3-bb38-4426-b4b4-6f76cb2f2720 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096442 Jul 14 11:06:21.274475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 441/891] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:06:21 2022] POST /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:06:21.332826 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:21.333402 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:21.335365 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=20 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:21.342124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:21.342583 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:21.343360 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:21.343802 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:21.429362 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.objects.instance [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lazy-loading 'services' on Instance uuid 00855c24-ab40-49a7-8a4c-52c2d6486cd2 {{(pid=133220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:06:21.509488 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-8d7bed60-4046-4db9-bc4e-a1fd6b9e6954 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments/b1235d2a-5118-401d-9d9d-68a03929bfa0" status: 202 len: 0 microversion: 2.1 time: 0.181377 Jul 14 11:06:21.510069 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 451/892] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:06:21 2022] DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments/b1235d2a-5118-401d-9d9d-68a03929bfa0 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:06:21.518805 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:21.519779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:21.527171 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:21.527529 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:21.528471 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:21.528986 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:21.559829 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-52f9a567-6513-476e-86c2-35dcde0ec91f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Jul 14 11:06:21.560408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 442/893] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:06:21 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:22.574219 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:22.575706 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:22.582789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:22.583228 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:22.584051 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:22.584479 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:22.613209 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a961eb30-0456-4cf9-a231-2a5e6c979c5d tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044563 Jul 14 11:06:22.613747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 452/894] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:06:22 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:06:22.683148 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:22.683946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:22.694948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:22.695656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:22.696928 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:22.697637 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:22.723534 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:06:22.807400 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7b80b5e0-3595-40f5-b227-d443cec1ecd8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 204 len: 0 microversion: 2.1 time: 0.130351 Jul 14 11:06:22.808000 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 443/895] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:06:22 2022] DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:06:22.816863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:22.817474 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:22.823601 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:22.824090 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:22.824917 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:22.825384 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:22.963034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:22.971133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b64d05f0-9ce0-40ce-b403-73c9d0a5d74f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1682 microversion: 2.1 time: 0.158230 Jul 14 11:06:22.971725 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 453/896] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:22 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:23.989743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:23.990438 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:23.997667 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:23.998114 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:23.998873 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:23.999299 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:24.129848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:24.137520 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-31729f4a-306d-45f4-89e7-a9184506be06 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1682 microversion: 2.1 time: 0.152133 Jul 14 11:06:24.138393 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 444/897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:23 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:25.156117 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:25.156750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:25.163485 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:25.163968 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:25.165079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:25.165519 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:25.205449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-4365cf87-00fe-4caa-85e5-0bdabfd1dd93 req-e462d11a-b6fc-4545-9642-112f07cdd431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00855c24-ab40-49a7-8a4c-52c2d6486cd2", "name": "network-vif-deleted", "tag": "f59d83db-92f9-4b4b-bb4b-63c49f876926"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:25.215083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-4365cf87-00fe-4caa-85e5-0bdabfd1dd93 req-e462d11a-b6fc-4545-9642-112f07cdd431 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:25.216050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-4365cf87-00fe-4caa-85e5-0bdabfd1dd93 req-e462d11a-b6fc-4545-9642-112f07cdd431 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:25.237151 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:25.240180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-4365cf87-00fe-4caa-85e5-0bdabfd1dd93 req-e462d11a-b6fc-4545-9642-112f07cdd431 service nova] Creating event network-vif-deleted:f59d83db-92f9-4b4b-bb4b-63c49f876926 for instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 on hv-cinder-84614 Jul 14 11:06:25.243728 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-a7f513fb-56c6-48c9-b57c-26f57709ecee tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 200 len: 1614 microversion: 2.1 time: 0.092733 Jul 14 11:06:25.253612 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-4365cf87-00fe-4caa-85e5-0bdabfd1dd93 req-e462d11a-b6fc-4545-9642-112f07cdd431 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043541 Jul 14 11:06:25.253612 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 445/898] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:25.254379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 454/899] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:25 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:26.262481 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:26.263492 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:26.270139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:26.270588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:26.271383 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:26.271821 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:26.285285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 HTTP/1.1 Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:06:26.286870 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:06:26.288334 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '00855c24-ab40-49a7-8a4c-52c2d6486cd2'} Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:06:26.289128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:06:26.290843 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:26.292691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:06:26.292691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-dc534bc4-7b4c-4ad6-9a8f-3e854f85a95f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 404 len: 111 microversion: 2.1 time: 0.030544 Jul 14 11:06:26.292691 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 446/900] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:26 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:06:26.298813 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-52907832-86d5-4fb7-81e4-7ffeff9082ec tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '.version_select at 0x7f13d433e430>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:26.325449 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-52907832-86d5-4fb7-81e4-7ffeff9082ec tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-758151164" status: 202 len: 0 microversion: 2.1 time: 0.031076 Jul 14 11:06:26.326194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 455/901] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 11:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-758151164 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:06:26.976122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a07fe480-7fb7-48f2-bb49-ce2054cb0a59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: .version_select at 0x7f13d42ef3a0>, body: {"keypair": {"name": "tempest-keypair-1896422223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/gTysNzWKT6mkybbe7FtSNTN5PoBGdWGNsPBTekIjf/toN6nvFVvCe3kYNjaKAZzU+fZT0R6tEFokLA3IsgO/bY6Yv9ZDKEEVlAYHhSfer1meBBdu9oqn6Cxk21GYaQ=="}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:26.990351 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-a07fe480-7fb7-48f2-bb49-ce2054cb0a59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:06:26.994283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.quota [None req-a07fe480-7fb7-48f2-bb49-ce2054cb0a59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'key_pairs'} {{(pid=133221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:06:27.019294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a07fe480-7fb7-48f2-bb49-ce2054cb0a59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047270 Jul 14 11:06:27.019860 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 447/902] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 11:06:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:28.579207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-82244735", "imageRef": "426ed30b-3e6b-4d34-a9e2-662a11c67613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42115c3-3c7a-438d-89c4-e806c3160582"}], "security_groups": [{"name": "tempest-securitygroup--1200836742"}], "key_name": "tempest-keypair-1896422223", "user_data": "}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:28.696781 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] validate_networks() for [('a42115c3-3c7a-438d-89c4-e806c3160582', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:06:29.074877 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:06:29.075548 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:06:29.076281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:06:29.076695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:06:29.077107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:06:29.086746 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:29.087503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:29.088359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:29.088771 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:29.106034 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:06:29.110218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Getting quotas for user 0141317702184143b85a9dce65ca3b84 and project 1bf3e1149d124a62b0984ec2598db78e. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:06:29.121965 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:06:29.124490 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='426ed30b-3e6b-4d34-a9e2-662a11c67613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:06:29.174094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-28b595e7-f66a-48c0-a646-f7873f628652 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.599806 Jul 14 11:06:29.174725 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 456/903] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:06:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:06:29.187601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b4ab0479-b351-47a4-a780-7e39e7363098 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:29.188327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b4ab0479-b351-47a4-a780-7e39e7363098 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:29.248112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b4ab0479-b351-47a4-a780-7e39e7363098 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:29.255308 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b4ab0479-b351-47a4-a780-7e39e7363098 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1240 microversion: 2.1 time: 0.073746 Jul 14 11:06:29.256143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 448/904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:29 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:30.273318 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:30.273934 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:30.280176 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:30.280617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:30.281382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:30.281812 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:30.353005 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:30.360796 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-76def5ee-d07f-4eec-875b-9f9d7ef4dc1c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1298 microversion: 2.1 time: 0.091970 Jul 14 11:06:30.370455 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 457/905] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:30 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:31.378748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:31.380093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:31.387772 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:31.388547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:31.389336 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:31.389780 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:31.515637 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-12c73712-073e-4e61-ad0d-b53c7d6396a9 req-2d123217-d8db-4d5e-a6b3-6192e2d1c4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7755a288-70bf-423a-abae-eee01a045ca6", "tag": "95d69d77-bd1e-417c-b7cd-d0eafdeb9556"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:31.527547 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-12c73712-073e-4e61-ad0d-b53c7d6396a9 req-2d123217-d8db-4d5e-a6b3-6192e2d1c4a1 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:31.528117 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-12c73712-073e-4e61-ad0d-b53c7d6396a9 req-2d123217-d8db-4d5e-a6b3-6192e2d1c4a1 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:31.545411 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-12c73712-073e-4e61-ad0d-b53c7d6396a9 req-2d123217-d8db-4d5e-a6b3-6192e2d1c4a1 service nova] Creating event network-changed:95d69d77-bd1e-417c-b7cd-d0eafdeb9556 for instance 7755a288-70bf-423a-abae-eee01a045ca6 on hv-cinder-84614 Jul 14 11:06:31.551218 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-12c73712-073e-4e61-ad0d-b53c7d6396a9 req-2d123217-d8db-4d5e-a6b3-6192e2d1c4a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039872 Jul 14 11:06:31.552280 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 458/906] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:31.620885 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:31.623564 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:31.632083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6d851a1b-d802-40db-9e8f-157efa41c5de tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.257422 Jul 14 11:06:31.641576 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 449/907] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:31 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:32.655185 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:32.655988 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:32.663615 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:32.664235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:32.665426 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:32.665910 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:32.887489 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:32.896296 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-933cab8f-e8b0-4215-8104-98e37a1c3336 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.248420 Jul 14 11:06:32.897221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 459/908] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:32 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:33.917771 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:33.918730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:33.927139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:33.927518 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:33.928329 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:33.928779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:34.204325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:34.212109 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-3a2dbfcb-2e56-4848-adcf-bcfd1ff891f8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.301201 Jul 14 11:06:34.212671 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 450/909] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:33 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:35.229659 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:35.230224 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:35.237322 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:35.237766 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:35.238585 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:35.239165 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:35.426094 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:35.437499 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6e4566ca-b94a-46d7-ae64-e0926e837b19 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.211440 Jul 14 11:06:35.438259 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 460/910] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:35 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:36.464448 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:36.465556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:36.468863 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:36.474480 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:36.474927 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:36.475699 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:36.476182 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:36.614409 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:36.622025 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b4d2719d-c0be-4c62-bcfb-53df0b1ce3b0 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.170709 Jul 14 11:06:36.622953 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 451/911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:36 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:37.147112 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-92ac416d-b153-435a-b7ef-36e5d39b3ad0 req-e744ee33-c061-4599-9658-7a40a2e5691e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7755a288-70bf-423a-abae-eee01a045ca6", "name": "network-vif-plugged", "status": "completed", "tag": "95d69d77-bd1e-417c-b7cd-d0eafdeb9556"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:37.157014 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-92ac416d-b153-435a-b7ef-36e5d39b3ad0 req-e744ee33-c061-4599-9658-7a40a2e5691e service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:37.157836 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-92ac416d-b153-435a-b7ef-36e5d39b3ad0 req-e744ee33-c061-4599-9658-7a40a2e5691e service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:37.169964 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-92ac416d-b153-435a-b7ef-36e5d39b3ad0 req-e744ee33-c061-4599-9658-7a40a2e5691e service nova] Creating event network-vif-plugged:95d69d77-bd1e-417c-b7cd-d0eafdeb9556 for instance 7755a288-70bf-423a-abae-eee01a045ca6 on hv-cinder-84614 Jul 14 11:06:37.174819 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-92ac416d-b153-435a-b7ef-36e5d39b3ad0 req-e744ee33-c061-4599-9658-7a40a2e5691e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 Jul 14 11:06:37.175417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 461/912] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:37.646399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:37.647294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:37.658374 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:37.659129 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:37.660587 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:37.661325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:37.803290 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:37.815453 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-abf21787-abe8-42d6-af70-5b3bf040ea4c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.175397 Jul 14 11:06:37.816354 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 452/913] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:37 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:38.837119 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:38.837822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:38.844843 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:38.845289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:38.846062 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:38.846495 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:38.986755 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:38.994999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c8794e10-631d-4f97-8031-b784c1361a73 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1366 microversion: 2.1 time: 0.162715 Jul 14 11:06:38.995538 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 462/914] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:38 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:40.014966 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:40.015551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:40.017970 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=6 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:40.023756 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:40.024236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:40.025014 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:40.025449 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:40.171817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:40.181178 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-09f5fbe1-f98a-4b3e-9a9e-d63f92a5da4f tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1556 microversion: 2.1 time: 0.171750 Jul 14 11:06:40.182039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 453/915] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:40 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:40.199815 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:40.200379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:40.202675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:40.203434 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:40.210150 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:40.210598 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:40.211370 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:40.211807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:40.293792 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c846bb10-92e0-4e30-a1f5-838d433f3ad8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097903 Jul 14 11:06:40.294864 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 463/916] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 11:06:40 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:41.029021 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-603059993"}} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:41.029669 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:41.036155 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:41.036602 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:41.037361 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:41.037784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:41.166307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.network.security_group_api [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Removing security group 2e6e24de-7cf4-40a7-9317-dd59bb6b0926 from port 2c07bf24-3abb-40af-9cc0-421d1cc3783a Jul 14 11:06:41.272685 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-cfecc3c0-98ed-410b-a9a2-8876a21da917 req-e5861e18-e814-47d9-878a-0047eb0ed655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7755a288-70bf-423a-abae-eee01a045ca6", "tag": "95d69d77-bd1e-417c-b7cd-d0eafdeb9556"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:41.281238 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-cfecc3c0-98ed-410b-a9a2-8876a21da917 req-e5861e18-e814-47d9-878a-0047eb0ed655 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:41.281676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-cfecc3c0-98ed-410b-a9a2-8876a21da917 req-e5861e18-e814-47d9-878a-0047eb0ed655 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:41.293187 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-cfecc3c0-98ed-410b-a9a2-8876a21da917 req-e5861e18-e814-47d9-878a-0047eb0ed655 service nova] Creating event network-changed:95d69d77-bd1e-417c-b7cd-d0eafdeb9556 for instance 7755a288-70bf-423a-abae-eee01a045ca6 on hv-cinder-84614 Jul 14 11:06:41.298820 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-cfecc3c0-98ed-410b-a9a2-8876a21da917 req-e5861e18-e814-47d9-878a-0047eb0ed655 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029623 Jul 14 11:06:41.300559 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 464/917] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:41.692231 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2cdd3c9f-ec7a-478b-aa5d-3fbcdd0f323c tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/action" status: 202 len: 0 microversion: 2.1 time: 0.667109 Jul 14 11:06:41.693440 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 454/918] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 11:06:41 2022] POST /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:06:41.741653 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-63f36ef9-9a97-44da-8454-5def28d3dac1 req-1937af71-36b9-4304-a53c-91f541eb8f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:41.750593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-63f36ef9-9a97-44da-8454-5def28d3dac1 req-1937af71-36b9-4304-a53c-91f541eb8f0c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:41.751423 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-63f36ef9-9a97-44da-8454-5def28d3dac1 req-1937af71-36b9-4304-a53c-91f541eb8f0c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:41.764316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-63f36ef9-9a97-44da-8454-5def28d3dac1 req-1937af71-36b9-4304-a53c-91f541eb8f0c service nova] Creating event network-changed:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:06:41.770601 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-63f36ef9-9a97-44da-8454-5def28d3dac1 req-1937af71-36b9-4304-a53c-91f541eb8f0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032954 Jul 14 11:06:41.771951 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 465/919] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:43.071011 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:43.071596 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:43.078817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:43.079270 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:43.080112 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:43.080556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:43.164401 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lazy-loading 'services' on Instance uuid 5fd0eafe-ac72-485e-b690-17292091d94d {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:06:43.239690 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-ed13ada0-7d1e-4e09-954a-c0b9a78396e2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments/90d9482e-1051-47c8-8d4a-943333e9de79" status: 202 len: 0 microversion: 2.1 time: 0.173113 Jul 14 11:06:43.240726 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 455/920] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:06:43 2022] DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments/90d9482e-1051-47c8-8d4a-943333e9de79 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:06:43.249652 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:43.250942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:43.258987 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:43.259513 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:43.260811 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:43.261605 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:43.296368 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fa333ea0-98c7-4b89-95ea-ac25c635d035 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051020 Jul 14 11:06:43.297100 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 466/921] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:06:43 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:43.314516 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-2a2ae5ac-3a97-4349-ad04-68cc34392c07 req-16eb6f49-d96a-4529-90d9-2b0b5784853c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:43.323157 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-2a2ae5ac-3a97-4349-ad04-68cc34392c07 req-16eb6f49-d96a-4529-90d9-2b0b5784853c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:43.323604 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-2a2ae5ac-3a97-4349-ad04-68cc34392c07 req-16eb6f49-d96a-4529-90d9-2b0b5784853c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:43.334901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-2a2ae5ac-3a97-4349-ad04-68cc34392c07 req-16eb6f49-d96a-4529-90d9-2b0b5784853c service nova] Creating event network-changed:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:06:43.342356 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-2a2ae5ac-3a97-4349-ad04-68cc34392c07 req-16eb6f49-d96a-4529-90d9-2b0b5784853c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031945 Jul 14 11:06:43.343389 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 456/922] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:06:44.312945 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:44.314367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:44.325328 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:44.326011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:44.326780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:44.327221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:44.356965 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-c019b096-0e94-4b2e-b7ab-ee39cc8060a2 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050808 Jul 14 11:06:44.357623 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 467/923] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:06:44 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:06:44.372553 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:44.373140 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:44.382730 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:44.383367 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:44.384561 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:44.385233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:44.465386 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] HTTP exception thrown: Instance 5fd0eafe-ac72-485e-b690-17292091d94d is not attached to volume 90d9482e-1051-47c8-8d4a-943333e9de79 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Request method failure captured: Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments/90d9482e-1051-47c8-8d4a-943333e9de79 HTTP/1.1 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_g2KX67zETl4aShXLQLYfTm9zm4LCg4jk92dm-MnAbHeMxOZ9s-5aQ1ixqw_51MiPTw_1Lev6-lEjMWg1fLNxEvIfdapaNW_Ri6kWkLmlJUTnf_xaasVCmSyFURoipmuxP7bAE-F2MSG5RreETTuwaLBqPRXM1jbCST2o7QsHz8Nz8 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: bf4b0509ba7049e9bcccf1231113c8d9 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-TestMinimumBasicScenario-1071147530 Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:06:44.467911 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-TestMinimumBasicScenario-1071147530 Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: bf4b0509ba7049e9bcccf1231113c8d9 Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1071147530 Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-TestMinimumBasicScenario-1071147530-project Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: b594d2cb0f104dd1b8567928e6a15581 Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-TestMinimumBasicScenario-1071147530-project Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:06:44.469554 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 5fd0eafe-ac72-485e-b690-17292091d94d is not attached to volume 90d9482e-1051-47c8-8d4a-943333e9de79 Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'server_id': '5fd0eafe-ac72-485e-b690-17292091d94d', 'id': '90d9482e-1051-47c8-8d4a-943333e9de79'} Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 90d9482e-1051-47c8-8d4a-943333e9de79. Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:06:44.470565 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd0eafe-ac72-485e-b690-17292091d94d is not attached to volume 90d9482e-1051-47c8-8d4a-943333e9de79 Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd0eafe-ac72-485e-b690-17292091d94d is not attached to volume 90d9482e-1051-47c8-8d4a-943333e9de79 Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:44.472165 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Returning 404 to user: Instance 5fd0eafe-ac72-485e-b690-17292091d94d is not attached to volume 90d9482e-1051-47c8-8d4a-943333e9de79 {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:06:44.473408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-fa753c08-93ec-4acf-968a-dd6904dcfa4f tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments/90d9482e-1051-47c8-8d4a-943333e9de79" status: 404 len: 154 microversion: 2.1 time: 0.104886 Jul 14 11:06:44.473408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 457/924] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:06:44 2022] DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d/os-volume_attachments/90d9482e-1051-47c8-8d4a-943333e9de79 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:06:45.612233 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:45.612733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:45.619675 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:45.620152 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:45.620913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:45.621342 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:45.624346 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=80,nova_cell1:INSERT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:45.648096 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Going to try to terminate instance {{(pid=133220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:06:45.743924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6855eb61-e57f-43f8-b913-7b5559ef4a07 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 204 len: 0 microversion: 2.1 time: 0.135226 Jul 14 11:06:45.744729 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 468/925] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:06:45 2022] DELETE /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:06:45.754407 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:45.755028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:45.762049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:45.762511 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:45.763283 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:45.763720 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:45.900044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:45.907775 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-b584b55d-ac50-48f5-bfa8-2784ed445746 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1553 microversion: 2.1 time: 0.157328 Jul 14 11:06:45.908406 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 458/926] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:45 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:06:46.930698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:46.931822 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:46.940473 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:46.940918 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:46.941694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:46.942530 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:47.078068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:47.085715 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-d69d9986-e601-4202-9647-f936dfb40df7 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1553 microversion: 2.1 time: 0.162209 Jul 14 11:06:47.086253 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 469/927] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:46 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:48.103597 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:48.104229 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:48.111044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:48.111500 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:48.112322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:48.112748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:48.388973 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b594d2cb0f104dd1b8567928e6a15581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0509ba7049e9bcccf1231113c8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:06:48.398856 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7292d731-79fa-4876-a6ce-3a40c2b3d525 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 200 len: 1553 microversion: 2.1 time: 0.299701 Jul 14 11:06:48.399430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 459/928] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:48 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 1553 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:06:48.411102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-893075dd-696d-4d57-b6e7-b354626752cd req-992dc684-ead0-4733-b071-e23ab189144c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd0eafe-ac72-485e-b690-17292091d94d", "name": "network-vif-deleted", "tag": "2c07bf24-3abb-40af-9cc0-421d1cc3783a"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:06:48.423654 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-893075dd-696d-4d57-b6e7-b354626752cd req-992dc684-ead0-4733-b071-e23ab189144c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:48.425267 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-893075dd-696d-4d57-b6e7-b354626752cd req-992dc684-ead0-4733-b071-e23ab189144c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:48.439041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-893075dd-696d-4d57-b6e7-b354626752cd req-992dc684-ead0-4733-b071-e23ab189144c service nova] Creating event network-vif-deleted:2c07bf24-3abb-40af-9cc0-421d1cc3783a for instance 5fd0eafe-ac72-485e-b690-17292091d94d on hv-cinder-84614 Jul 14 11:06:48.444973 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-893075dd-696d-4d57-b6e7-b354626752cd req-992dc684-ead0-4733-b071-e23ab189144c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037937 Jul 14 11:06:48.447309 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 470/929] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:06:49.420881 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:49.422143 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] [instance: 5fd0eafe-ac72-485e-b690-17292091d94d] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:06:49.433122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:49.433862 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:49.435111 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:06:49.435833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:06:49.450327 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] HTTP exception thrown: Instance 5fd0eafe-ac72-485e-b690-17292091d94d could not be found. Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Request method failure captured: Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d HTTP/1.1 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_g2KX67zETl4aShXLQLYfTm9zm4LCg4jk92dm-MnAbHeMxOZ9s-5aQ1ixqw_51MiPTw_1Lev6-lEjMWg1fLNxEvIfdapaNW_Ri6kWkLmlJUTnf_xaasVCmSyFURoipmuxP7bAE-F2MSG5RreETTuwaLBqPRXM1jbCST2o7QsHz8Nz8 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: bf4b0509ba7049e9bcccf1231113c8d9 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-TestMinimumBasicScenario-1071147530 Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:06:49.451868 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf4b0509ba7049e9bcccf1231113c8d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-TestMinimumBasicScenario-1071147530 Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: bf4b0509ba7049e9bcccf1231113c8d9 Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1071147530 Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-TestMinimumBasicScenario-1071147530-project Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: b594d2cb0f104dd1b8567928e6a15581 Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-TestMinimumBasicScenario-1071147530-project Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 5fd0eafe-ac72-485e-b690-17292091d94d could not be found. Jul 14 11:06:49.453482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '5fd0eafe-ac72-485e-b690-17292091d94d'} Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd0eafe-ac72-485e-b690-17292091d94d could not be found. Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:06:49.454430 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd0eafe-ac72-485e-b690-17292091d94d could not be found. Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd0eafe-ac72-485e-b690-17292091d94d could not be found. Jul 14 11:06:49.456050 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:06:49.457475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Returning 404 to user: Instance 5fd0eafe-ac72-485e-b690-17292091d94d could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:06:49.457475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7bc97616-1e32-4bd2-8378-a523b17acad1 tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d" status: 404 len: 111 microversion: 2.1 time: 0.039517 Jul 14 11:06:49.457475 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 460/930] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:06:49 2022] GET /compute/v2.1/servers/5fd0eafe-ac72-485e-b690-17292091d94d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:06:49.462998 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-16011b2c-b3be-4d6a-9cda-893e3f4c7aca tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] Calling method '.version_select at 0x7f13d43a0430>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:06:49.487946 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-16011b2c-b3be-4d6a-9cda-893e3f4c7aca tempest-TestMinimumBasicScenario-1071147530 tempest-TestMinimumBasicScenario-1071147530-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-747613914" status: 202 len: 0 microversion: 2.1 time: 0.029032 Jul 14 11:06:49.488466 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 471/931] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jul 14 11:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-747613914 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:06:53.937282 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:06:53.937862 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:06:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:07:15.549315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:15.550482 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:15.553393 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=19 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:15.554414 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:15.564991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:15.565438 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:15.566230 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:15.566661 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:15.590457 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-128433ad-f295-4290-af5e-1586ce80d589 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/ips" status: 200 len: 149 microversion: 2.1 time: 0.048477 Jul 14 11:07:15.591008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 461/932] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 11:07:15 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:16.947619 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:16.948550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:16.953620 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3590ddff-3d31-46bb-9e84-e9c8a491539e"}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:16.958277 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:16.970310 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:16.970761 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:16.971535 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:16.971999 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:17.237562 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-176403b2-219e-40cc-9cfc-38c5d4741d59 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "POST /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292351 Jul 14 11:07:17.238231 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 472/933] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 11:07:16 2022] POST /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:20.750150 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:20.750709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:20.757485 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:20.757938 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:20.758693 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:20.759124 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:20.784345 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:07:20.864148 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-902568c6-77f1-4e7f-a864-636cbfed38be tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 204 len: 0 microversion: 2.1 time: 0.119774 Jul 14 11:07:20.864739 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 462/934] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:07:20 2022] DELETE /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:07:20.875281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:20.876334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:20.882923 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:20.883376 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:20.884214 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:20.884653 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:21.022885 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:21.030532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5cd228f5-8db5-49fb-b0f5-bdc4088215e0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1576 microversion: 2.1 time: 0.160172 Jul 14 11:07:21.031073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 473/935] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:20 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:22.051863 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:22.052595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:22.060244 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:22.060729 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:22.061495 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:22.061938 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:22.200443 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:22.208401 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5875376d-c008-45a1-8bd6-461964133391 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1576 microversion: 2.1 time: 0.163447 Jul 14 11:07:22.208956 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 463/936] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:22 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:23.232763 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:23.233445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:23.241981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:23.242133 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:23.242921 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:23.243364 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:23.298406 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-9395c75c-c89c-4bbd-a069-066658a62582 req-7dbc4eeb-b207-40ff-8e36-3de98a94da89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d1cdef-50ab-43b3-81eb-22803f438496", "name": "network-vif-deleted", "tag": "c4aa472a-2608-44b3-abbd-d79763163f60"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:23.313601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-9395c75c-c89c-4bbd-a069-066658a62582 req-7dbc4eeb-b207-40ff-8e36-3de98a94da89 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:23.313931 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-9395c75c-c89c-4bbd-a069-066658a62582 req-7dbc4eeb-b207-40ff-8e36-3de98a94da89 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:23.330793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:23.340056 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-9395c75c-c89c-4bbd-a069-066658a62582 req-7dbc4eeb-b207-40ff-8e36-3de98a94da89 service nova] Creating event network-vif-deleted:c4aa472a-2608-44b3-abbd-d79763163f60 for instance a9d1cdef-50ab-43b3-81eb-22803f438496 on hv-cinder-84614 Jul 14 11:07:23.347306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-9395c75c-c89c-4bbd-a069-066658a62582 req-7dbc4eeb-b207-40ff-8e36-3de98a94da89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052216 Jul 14 11:07:23.348294 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 464/937] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:23.354221 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5a4bc0a4-945e-4c7e-a742-675339ab29f0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 200 len: 1508 microversion: 2.1 time: 0.127956 Jul 14 11:07:23.355460 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 474/938] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:23 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 1508 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:23.839485 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:23.840117 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:23.846630 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:23.847073 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:23.847833 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:23.848315 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:23.942312 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lazy-loading 'services' on Instance uuid 7755a288-70bf-423a-abae-eee01a045ca6 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:07:24.024044 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-37797bf7-aad6-4538-aba1-fe397947b045 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments/3590ddff-3d31-46bb-9e84-e9c8a491539e" status: 202 len: 0 microversion: 2.1 time: 0.188568 Jul 14 11:07:24.024731 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 465/939] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 11:07:23 2022] DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments/3590ddff-3d31-46bb-9e84-e9c8a491539e => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:07:24.033733 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:24.035011 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:24.042623 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:24.043335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:24.044197 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:24.044627 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:24.076688 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6402481d-c469-477a-bbe7-a9e88e7edb7c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047375 Jul 14 11:07:24.077248 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 475/940] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:07:24 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:24.373372 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:24.374022 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:24.380975 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:24.381556 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:24.382438 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:24.383049 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:24.397458 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] HTTP exception thrown: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Request method failure captured: Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 HTTP/1.1 Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_hAW_3pAR3lrIpc0QO8hArsD6rvU3MvE29o8ifXghhvncX_cQF2nUz5YVF1EYDnRP8IV5tgrlJxPsoJU-KS4h5Ns6acxUrpIjhkZDp8BeiBmox31wZCaG5dHbgtVWlsrHi36VnA0l0NWOL9fFHpTDdajrIZiNVhdRP4XTOdllwYGKQ Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:07:24.399536 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fea9c5d098d646b89213d35f737e2308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 2e2b4b08c1b34a7f86996a806953ac1d Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:07:24.401092 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'a9d1cdef-50ab-43b3-81eb-22803f438496'} Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:24.402127 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:07:24.403478 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:24.404743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Returning 404 to user: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:24.404743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-6e50204a-d9f6-42ad-b093-1de02575d9a0 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 404 len: 111 microversion: 2.1 time: 0.032483 Jul 14 11:07:24.404743 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 466/941] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:24 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:24.496732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-425313435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-688443031", "security_groups": [{"name": "tempest-secgroup-smoke-1894027251"}], "block_device_mapping_v2": [{"uuid": "bb25a2f7-a4d9-4f74-996b-82ffe7fa5182", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9328a65e-5214-4b81-8acd-9147149014ec"}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:24.619445 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] validate_networks() for [('9328a65e-5214-4b81-8acd-9147149014ec', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:07:25.008610 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:07:25.009275 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:07:25.009968 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:07:25.010482 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:07:25.011073 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:07:25.025227 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.025643 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.026457 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.026886 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.044436 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for project fea9c5d098d646b89213d35f737e2308. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:07:25.048756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for user 2e2b4b08c1b34a7f86996a806953ac1d and project fea9c5d098d646b89213d35f737e2308. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:07:25.089161 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.090095 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:25.096658 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.097176 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.097942 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.098370 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.108777 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:07:25.110984 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb25a2f7-a4d9-4f74-996b-82ffe7fa5182',volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:07:25.128233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d1994809-2b37-4235-9446-fc7d5d449a8a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042907 Jul 14 11:07:25.128897 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 467/942] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:07:25.186757 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.187357 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:25.193687 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.194223 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.195053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.195512 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.220778 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:07:25.249076 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3a9b6346-1be9-402c-a20d-e0504930acb4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756268 Jul 14 11:07:25.249719 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 476/943] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:07:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:07:25.259827 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6c6b7117-6493-4b16-a1e6-9bf719cd7546 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.260451 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6c6b7117-6493-4b16-a1e6-9bf719cd7546 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:25.315332 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-e6a762f5-560f-4098-81fa-bcab23ece19b tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 204 len: 0 microversion: 2.1 time: 0.132154 Jul 14 11:07:25.316342 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 468/944] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:07:25 2022] DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:07:25.324531 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:25.325307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:25.331584 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6c6b7117-6493-4b16-a1e6-9bf719cd7546 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:25.332398 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.332909 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.333747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:25.334333 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:25.339110 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6c6b7117-6493-4b16-a1e6-9bf719cd7546 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1093 microversion: 2.1 time: 0.083107 Jul 14 11:07:25.339682 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 477/945] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:07:25.468237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:25.476399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-759b787f-2db4-4044-a0fb-48fe7fab2840 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1680 microversion: 2.1 time: 0.155832 Jul 14 11:07:25.476960 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 469/946] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:25 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:07:26.356949 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:26.357549 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:26.364819 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:26.365270 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:26.366041 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:26.366482 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:26.432985 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:26.440882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-927026af-6fb3-4658-a5f3-790952f46a5b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1143 microversion: 2.1 time: 0.087840 Jul 14 11:07:26.441441 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 478/947] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:26.495767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:26.496664 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:26.505174 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:26.505634 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:26.506403 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:26.506838 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:26.647055 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:26.663180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-d042b7e5-6203-4999-935f-28b0de08aa2a tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1680 microversion: 2.1 time: 0.172509 Jul 14 11:07:26.666571 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 470/948] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:26 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:27.457859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:27.458654 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:27.465264 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:27.465791 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:27.466723 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:27.467359 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:27.581687 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:27.590684 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-fd4c58cd-1c39-4fe2-ab1b-f85e3956ec7b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1209 microversion: 2.1 time: 0.137136 Jul 14 11:07:27.592328 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 479/949] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:27 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:27.683007 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:27.683639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:27.691530 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:27.692237 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:27.693248 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:27.694007 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:28.025451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0141317702184143b85a9dce65ca3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf3e1149d124a62b0984ec2598db78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:28.033514 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-439cd226-ef82-4c1f-8cd4-a96bc4c5359c tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 200 len: 1680 microversion: 2.1 time: 0.355189 Jul 14 11:07:28.034180 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 471/950] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:27 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 1680 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:28.395617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-1f646c12-d070-4244-99bf-247e02773362 req-e8ba1ff4-a07c-4211-a05f-729756b40f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7755a288-70bf-423a-abae-eee01a045ca6", "name": "network-vif-deleted", "tag": "95d69d77-bd1e-417c-b7cd-d0eafdeb9556"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:28.412786 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1f646c12-d070-4244-99bf-247e02773362 req-e8ba1ff4-a07c-4211-a05f-729756b40f59 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:28.413568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1f646c12-d070-4244-99bf-247e02773362 req-e8ba1ff4-a07c-4211-a05f-729756b40f59 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:28.436194 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-1f646c12-d070-4244-99bf-247e02773362 req-e8ba1ff4-a07c-4211-a05f-729756b40f59 service nova] Creating event network-vif-deleted:95d69d77-bd1e-417c-b7cd-d0eafdeb9556 for instance 7755a288-70bf-423a-abae-eee01a045ca6 on hv-cinder-84614 Jul 14 11:07:28.443859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-1f646c12-d070-4244-99bf-247e02773362 req-e8ba1ff4-a07c-4211-a05f-729756b40f59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051822 Jul 14 11:07:28.445170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 480/951] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:28.608981 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:28.609654 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:28.616692 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:28.617139 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:28.617946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:28.618382 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:28.766733 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:28.782477 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4ce6e4b7-b69d-4ca5-a270-eddf33de6356 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.177395 Jul 14 11:07:28.783189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 472/952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:28 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:29.053157 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:29.054047 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:29.061854 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:29.062600 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:29.063437 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:29.064341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:29.079050 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 HTTP/1.1 Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:07:29.081190 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:29.082750 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '7755a288-70bf-423a-abae-eee01a045ca6'} Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:29.083745 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:29.085593 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:29.086774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:29.086774 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4b63d710-1388-4b76-8d72-23f492f33844 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 404 len: 111 microversion: 2.1 time: 0.035665 Jul 14 11:07:29.088535 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 481/953] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:29 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:29.093603 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-9ff7d216-4bab-4736-9e6c-f164c4705000 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '.version_select at 0x7f13d42e09d0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:29.114540 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-9ff7d216-4bab-4736-9e6c-f164c4705000 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896422223" status: 202 len: 0 microversion: 2.1 time: 0.024709 Jul 14 11:07:29.115226 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 473/954] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 11:07:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896422223 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:07:29.803956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:29.804866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:29.813332 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:29.813920 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:29.814779 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:29.815441 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:30.082762 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:30.091170 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-36f96533-9f72-45e7-a641-a52698783aef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.295018 Jul 14 11:07:30.091971 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 482/955] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:29 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:30.475857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-8f135ec5-b311-42bb-9efa-69ff84c1c867 req-ede58fe6-ed5a-43e2-b4d8-a76d1dd23504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ada1cc5-93f4-4d4a-b069-7b0303071070", "tag": "aadcf85d-e1cb-4737-b730-0eea8a34faa0"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:30.485368 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-8f135ec5-b311-42bb-9efa-69ff84c1c867 req-ede58fe6-ed5a-43e2-b4d8-a76d1dd23504 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:30.486298 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-8f135ec5-b311-42bb-9efa-69ff84c1c867 req-ede58fe6-ed5a-43e2-b4d8-a76d1dd23504 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:30.496836 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-8f135ec5-b311-42bb-9efa-69ff84c1c867 req-ede58fe6-ed5a-43e2-b4d8-a76d1dd23504 service nova] Creating event network-changed:aadcf85d-e1cb-4737-b730-0eea8a34faa0 for instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 on hv-cinder-84614 Jul 14 11:07:30.502904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-8f135ec5-b311-42bb-9efa-69ff84c1c867 req-ede58fe6-ed5a-43e2-b4d8-a76d1dd23504 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031350 Jul 14 11:07:30.503483 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 474/956] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:30.990948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:30.991451 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:30.997756 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:30.998210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:30.998983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:30.999416 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.013502 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 HTTP/1.1 Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:07:31.015261 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.017077 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '7755a288-70bf-423a-abae-eee01a045ca6'} Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:31.017922 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.019378 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.021014 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:31.021014 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-da2a18d4-09d7-4a0d-a463-69bce0f48e49 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 404 len: 111 microversion: 2.1 time: 0.029707 Jul 14 11:07:31.021014 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 483/957] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:07:30 2022] DELETE /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:31.026286 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:31.026993 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 7755a288-70bf-423a-abae-eee01a045ca6] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:31.033555 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:31.034009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.034776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:31.035210 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.049299 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 HTTP/1.1 Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:07:31.050926 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.052532 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '7755a288-70bf-423a-abae-eee01a045ca6'} Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:31.053464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. Jul 14 11:07:31.055039 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:31.056427 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 7755a288-70bf-423a-abae-eee01a045ca6 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:31.056427 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-cd78066b-7baf-491a-81cf-8abeb8fa4eaf tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6" status: 404 len: 111 microversion: 2.1 time: 0.030290 Jul 14 11:07:31.056427 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 475/958] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:31 2022] GET /compute/v2.1/servers/7755a288-70bf-423a-abae-eee01a045ca6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:31.110695 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:31.111506 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:31.122035 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:31.122485 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.123263 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:31.123699 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:31.263398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:31.271398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-22c00eea-06cd-4958-bb40-e257138e4368 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.165651 Jul 14 11:07:31.272042 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 484/959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:31 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:32.203490 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:32.204113 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:32.211123 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.211591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.212398 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.212835 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.226904 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 HTTP/1.1 Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:07:32.228494 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.230110 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '00855c24-ab40-49a7-8a4c-52c2d6486cd2'} Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:32.231179 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.232747 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.234621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:32.234621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-7164db85-626f-42c3-9906-c1e1ddef8fa8 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 404 len: 111 microversion: 2.1 time: 0.030861 Jul 14 11:07:32.234621 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 476/960] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:07:32 2022] DELETE /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:32.238398 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:32.239013 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 00855c24-ab40-49a7-8a4c-52c2d6486cd2] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:32.246022 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.246476 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.247242 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.247678 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.263005 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 HTTP/1.1 Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:07:32.264568 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.266188 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '00855c24-ab40-49a7-8a4c-52c2d6486cd2'} Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:32.267272 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. Jul 14 11:07:32.268873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.270305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 00855c24-ab40-49a7-8a4c-52c2d6486cd2 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:32.270305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e07c092e-fd54-4af3-af65-9dfe809e6347 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2" status: 404 len: 111 microversion: 2.1 time: 0.031537 Jul 14 11:07:32.270305 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 485/961] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:32 2022] GET /compute/v2.1/servers/00855c24-ab40-49a7-8a4c-52c2d6486cd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:32.274830 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:32.275336 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:32.281737 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.282189 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.282959 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.283394 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.290080 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:32.290679 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:32.297475 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.297651 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.298207 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.298738 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: DELETE /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 HTTP/1.1 Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:07:32.299158 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.300983 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '79b0a3f5-054c-438a-a09a-510002782388'} Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:32.302053 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.303496 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.305173 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.305278 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:32.305278 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8355ab0c-f2d9-48c3-aebd-ef8087d872c5 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 404 len: 111 microversion: 2.1 time: 0.029793 Jul 14 11:07:32.305278 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 477/962] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:07:32 2022] DELETE /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:32.309093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:32.309709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: 79b0a3f5-054c-438a-a09a-510002782388] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:32.315993 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.316451 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.317219 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:32.317996 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:32.331404 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 HTTP/1.1 Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:07:32.332948 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.334848 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': '79b0a3f5-054c-438a-a09a-510002782388'} Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:32.335817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. Jul 14 11:07:32.337429 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:07:32.338808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance 79b0a3f5-054c-438a-a09a-510002782388 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:32.338808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-152c78bc-67c2-4516-b2a6-477fdad29118 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388" status: 404 len: 111 microversion: 2.1 time: 0.028881 Jul 14 11:07:32.338808 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 478/963] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:32 2022] GET /compute/v2.1/servers/79b0a3f5-054c-438a-a09a-510002782388 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:32.440993 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:32.448942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6c23980a-c5f1-4ae7-ba9f-1f702e8ac891 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.162701 Jul 14 11:07:32.449494 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 486/964] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:32 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:07:33.469754 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:33.471046 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:33.476851 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:33.477293 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:33.478057 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:33.478487 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:33.484126 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:33.484654 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:33.492119 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:33.492572 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:33.493350 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:33.493764 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:33.496991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:33.508908 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 HTTP/1.1 Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:07:33.510472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.512281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'd73519f9-0e9d-41ab-ba9b-619cf97f8822'} Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:33.513230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.515122 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.516525 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:33.516525 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-6ba92678-f62e-49e3-928d-770102e33393 tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 404 len: 111 microversion: 2.1 time: 0.031755 Jul 14 11:07:33.516525 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 487/965] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:07:33 2022] DELETE /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:33.524204 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:33.524832 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] [instance: d73519f9-0e9d-41ab-ba9b-619cf97f8822] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:33.531508 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:33.531983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:33.533289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:33.533727 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:33.547723 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] HTTP exception thrown: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Request method failure captured: Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 HTTP/1.1 Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_fkauuF65Htbkl4csyScsnrZcsjh60CTQLCFvIeGxsualZ2lWFpcmWdEC-pf9nJMUj-OqPP984NDQnTf5FeCRARj-Tq3OS31LMstLfaFPKCLnhgXRWXKqdpULg0jUBpey222tQ5vSqyXXEOFsIvott3RxbGttU-JjPu5QlzBhDmYs8 Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:07:33.549698 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf3e1149d124a62b0984ec2598db78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: 1bf3e1149d124a62b0984ec2598db78e Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2095532687 Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 0141317702184143b85a9dce65ca3b84 Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-AttachVolumeNegativeTest-2095532687-project Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.551282 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'd73519f9-0e9d-41ab-ba9b-619cf97f8822'} Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:07:33.552247 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. Jul 14 11:07:33.553747 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:07:33.555102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] Returning 404 to user: Instance d73519f9-0e9d-41ab-ba9b-619cf97f8822 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:07:33.555102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-4c9350d2-7c52-47ae-8e2b-294ab68994ed tempest-AttachVolumeNegativeTest-2095532687 tempest-AttachVolumeNegativeTest-2095532687-project] 10.222.0.27 "GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822" status: 404 len: 111 microversion: 2.1 time: 0.030650 Jul 14 11:07:33.555102 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 488/966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:33 2022] GET /compute/v2.1/servers/d73519f9-0e9d-41ab-ba9b-619cf97f8822 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:07:33.624188 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:33.632567 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-39c8c015-b998-47e8-a1a0-9307acb2663b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.169490 Jul 14 11:07:33.633136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 479/967] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:33 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:34.649444 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:34.650044 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:34.657859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:34.659032 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:34.659905 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:34.660491 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:34.800236 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:34.808863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-270be080-18a6-451d-8b2b-a58488eb57e4 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.163321 Jul 14 11:07:34.809797 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 489/968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:34 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:35.826699 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:35.827279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:35.834205 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:35.834676 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:35.835486 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:35.836054 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:35.984695 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:35.998236 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c1b67be8-a18e-40a5-9769-6477e97be305 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.175538 Jul 14 11:07:36.002154 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 480/969] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:35 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:37.016592 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:37.017311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:37.019505 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:37.021768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=8 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:37.029079 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:37.029514 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:37.030407 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:37.030840 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:37.169676 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:37.177555 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5e5c8f64-fee7-486e-9930-a7b96c82b9c8 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.165272 Jul 14 11:07:37.178140 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 490/970] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:37 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:38.195390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:38.195945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:38.202578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.203018 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.203776 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:38.204243 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:38.349993 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:38.358082 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-1a1da625-3490-4511-8096-2d71fcb3de5c tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.166689 Jul 14 11:07:38.358652 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 481/971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:38 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:39.375658 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:39.377213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:39.383472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:39.384148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:39.385090 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:39.385718 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:39.621580 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:39.643467 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-5b22875b-921b-49bb-b462-d80855c35d4d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.272598 Jul 14 11:07:39.644091 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 491/972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:39 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:39.761428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-c5b90552-5905-45d6-a187-16b3cd9ebae4 req-7ea3363d-6414-4696-8d1a-c4d2f17cd404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ada1cc5-93f4-4d4a-b069-7b0303071070", "name": "network-vif-plugged", "status": "completed", "tag": "aadcf85d-e1cb-4737-b730-0eea8a34faa0"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:39.770467 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-c5b90552-5905-45d6-a187-16b3cd9ebae4 req-7ea3363d-6414-4696-8d1a-c4d2f17cd404 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:39.770991 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-c5b90552-5905-45d6-a187-16b3cd9ebae4 req-7ea3363d-6414-4696-8d1a-c4d2f17cd404 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:39.797083 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-c5b90552-5905-45d6-a187-16b3cd9ebae4 req-7ea3363d-6414-4696-8d1a-c4d2f17cd404 service nova] Creating event network-vif-plugged:aadcf85d-e1cb-4737-b730-0eea8a34faa0 for instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 on hv-cinder-84614 Jul 14 11:07:39.802659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-c5b90552-5905-45d6-a187-16b3cd9ebae4 req-7ea3363d-6414-4696-8d1a-c4d2f17cd404 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243337 Jul 14 11:07:39.803310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 482/973] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:40.659694 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:40.660390 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:40.669503 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.670147 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.671154 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:40.671749 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:40.811630 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:40.816302 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:40.821330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-b22e93b0-2f42-47cc-b0b5-f9f90282c400 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1265 microversion: 2.1 time: 0.165515 Jul 14 11:07:40.821917 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 492/974] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:40 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:41.840825 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:41.841497 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:41.848197 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.848639 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.849402 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:41.849829 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:41.986513 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:41.994436 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5a03a630-d64e-403f-a04e-a8d006286ac6 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1452 microversion: 2.1 time: 0.159017 Jul 14 11:07:41.995248 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 483/975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:41 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:42.012153 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:42.013111 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:07:42.020953 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:42.021475 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:42.022367 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:42.023023 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:42.165789 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:07:42.176296 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-51080f09-920f-47e3-9c7c-2812fd13e138 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1452 microversion: 2.1 time: 0.168647 Jul 14 11:07:42.176863 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 493/976] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:07:42 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:07:43.854331 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [req-1351f696-b9b4-41df-acb2-71c9f7d8eb11 req-2e943b50-4ae9-4bfa-a011-894725259cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ada1cc5-93f4-4d4a-b069-7b0303071070", "tag": "aadcf85d-e1cb-4737-b730-0eea8a34faa0"}]} {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:07:43.863187 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-1351f696-b9b4-41df-acb2-71c9f7d8eb11 req-2e943b50-4ae9-4bfa-a011-894725259cb2 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:43.863715 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [req-1351f696-b9b4-41df-acb2-71c9f7d8eb11 req-2e943b50-4ae9-4bfa-a011-894725259cb2 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:43.875031 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.compute.server_external_events [req-1351f696-b9b4-41df-acb2-71c9f7d8eb11 req-2e943b50-4ae9-4bfa-a011-894725259cb2 service nova] Creating event network-changed:aadcf85d-e1cb-4737-b730-0eea8a34faa0 for instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 on hv-cinder-84614 Jul 14 11:07:43.881946 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [req-1351f696-b9b4-41df-acb2-71c9f7d8eb11 req-2e943b50-4ae9-4bfa-a011-894725259cb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031001 Jul 14 11:07:43.883202 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 484/977] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:28.621556 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:28.622313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:28.626426 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-939841895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-688443031", "security_groups": [{"name": "tempest-secgroup-smoke-1894027251"}], "block_device_mapping_v2": [{"uuid": "866ca2f7-ffbb-47cd-86bf-efcce824d719", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9328a65e-5214-4b81-8acd-9147149014ec"}]}} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:28.743329 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.network.neutron [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] validate_networks() for [('9328a65e-5214-4b81-8acd-9147149014ec', None, None, None, None, None)] {{(pid=133220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:09:29.246933 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Flavor limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:09:29.247639 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Image limits 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:09:29.248633 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Flavor pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:09:29.249334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Image pref 0:0:0 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:09:29.250017 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.virt.hardware [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:09:29.265048 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:29.265741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:29.267059 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:29.267776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:29.288607 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for project fea9c5d098d646b89213d35f737e2308. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:09:29.292686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.quota [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Getting quotas for user 2e2b4b08c1b34a7f86996a806953ac1d and project fea9c5d098d646b89213d35f737e2308. Resources: {'cores', 'ram', 'instances'} {{(pid=133220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:09:29.361063 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Going to run 1 instances... {{(pid=133220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:09:29.363162 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='866ca2f7-ffbb-47cd-86bf-efcce824d719',volume_size=None,volume_type=None)] {{(pid=133220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:09:29.510281 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-82a570f3-76dd-42e2-93e5-d15a59861a0a tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.890042 Jul 14 11:09:29.510787 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 494/978] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 11:09:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:09:29.519436 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:29.520324 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=24 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:29.526305 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-301f1b23-a837-4ea0-bb21-89f7cc2b888f tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:29.527194 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-301f1b23-a837-4ea0-bb21-89f7cc2b888f tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:29.584421 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-301f1b23-a837-4ea0-bb21-89f7cc2b888f tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:29.591560 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-301f1b23-a837-4ea0-bb21-89f7cc2b888f tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1093 microversion: 2.1 time: 0.074168 Jul 14 11:09:29.592178 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 485/979] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:29 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:30.609635 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:30.610245 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:30.617320 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:30.617813 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:30.618609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:30.619167 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:30.691892 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:30.702891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e410d26b-5f50-4d54-b69c-906d7976bb49 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1209 microversion: 2.1 time: 0.097128 Jul 14 11:09:30.703586 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 495/980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:30 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:31.721547 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:31.722941 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:31.730144 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:31.730591 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:31.731653 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:31.731777 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:31.986566 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-818407fc-e045-456a-bf78-20a3c1641242 req-141e9455-a77f-4fea-b92e-20dafc8d0a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cd4aab-65dd-44ea-9210-31ae5511a00e", "tag": "836d9cc5-a43b-4696-b4d2-34f25fa20d8c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:31.994897 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-818407fc-e045-456a-bf78-20a3c1641242 req-141e9455-a77f-4fea-b92e-20dafc8d0a13 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:31.995334 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-818407fc-e045-456a-bf78-20a3c1641242 req-141e9455-a77f-4fea-b92e-20dafc8d0a13 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:32.010961 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-818407fc-e045-456a-bf78-20a3c1641242 req-141e9455-a77f-4fea-b92e-20dafc8d0a13 service nova] Creating event network-changed:836d9cc5-a43b-4696-b4d2-34f25fa20d8c for instance a7cd4aab-65dd-44ea-9210-31ae5511a00e on hv-cinder-84614 Jul 14 11:09:32.017055 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-818407fc-e045-456a-bf78-20a3c1641242 req-141e9455-a77f-4fea-b92e-20dafc8d0a13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179097 Jul 14 11:09:32.018107 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 496/981] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:09:32.030122 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:32.042346 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-f282500a-ef4a-4b60-91d1-2c0b743090a5 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.325402 Jul 14 11:09:32.042889 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 486/982] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:31 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:33.065235 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:33.065948 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:33.072776 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:33.073213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:33.073981 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:33.074408 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:33.208324 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:33.220273 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-bd3d865e-534c-44eb-91d1-00d63538bcaf tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.158926 Jul 14 11:09:33.221065 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 497/983] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:33 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:34.243709 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:34.244813 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:34.255758 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:34.256534 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:34.257800 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:34.258525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:34.403643 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:34.415393 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-95ad8270-e4eb-4358-8b18-f9dd3b6e08d2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.177957 Jul 14 11:09:34.416187 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 487/984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:34 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:35.436557 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:35.437553 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:35.448670 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:35.449124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:35.449900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:35.450357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:35.594768 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:35.604914 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-780889e2-5924-4abb-a308-857c215ed050 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.175378 Jul 14 11:09:35.605492 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 498/985] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:35 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:36.626740 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:36.627714 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:36.639010 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:36.639748 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:36.641052 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:36.641767 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:36.786578 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:36.794826 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-15c91550-95ed-4f1d-9d54-c28e124ce890 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.174850 Jul 14 11:09:36.795400 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 488/986] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:36 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:37.816335 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:37.817357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:37.826814 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:37.827330 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:37.828144 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:37.828617 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:37.966937 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:37.974780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-717c50dd-8b8f-406a-91a4-67098a9377e1 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.165032 Jul 14 11:09:37.975326 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 499/987] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:37 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:38.992010 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:38.992659 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:38.999508 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:38.999978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:39.000741 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:39.001168 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:39.142419 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:39.153399 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c114574e-b65c-4f03-8305-3403fe45ab28 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.165372 Jul 14 11:09:39.153964 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 489/988] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:38 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:40.170532 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:40.171134 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:40.173609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=2 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:40.174611 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell0:SELECT=6 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:40.180897 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:40.181345 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:40.182155 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:40.182603 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:40.324289 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:40.332030 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-32cee9fb-0a6a-4342-a491-f96dd22dce22 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.165499 Jul 14 11:09:40.332807 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 500/989] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:40 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:41.354325 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell0:SELECT=2 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:41.431853 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:41.432499 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:41.439101 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.439551 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.440360 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:41.440797 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:41.583028 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:41.595571 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-942f3288-c9a3-40ca-a670-0058f33966fe tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.248535 Jul 14 11:09:41.596464 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 490/990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:41 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:42.036379 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-14b8e2b0-fd01-4b33-9c9c-7bdd02e7ba14 req-77ec927a-ade4-4565-a5ff-d050cdd13208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cd4aab-65dd-44ea-9210-31ae5511a00e", "name": "network-vif-plugged", "status": "completed", "tag": "836d9cc5-a43b-4696-b4d2-34f25fa20d8c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:42.045257 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-14b8e2b0-fd01-4b33-9c9c-7bdd02e7ba14 req-77ec927a-ade4-4565-a5ff-d050cdd13208 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:42.045702 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-14b8e2b0-fd01-4b33-9c9c-7bdd02e7ba14 req-77ec927a-ade4-4565-a5ff-d050cdd13208 service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:42.057302 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-14b8e2b0-fd01-4b33-9c9c-7bdd02e7ba14 req-77ec927a-ade4-4565-a5ff-d050cdd13208 service nova] Creating event network-vif-plugged:836d9cc5-a43b-4696-b4d2-34f25fa20d8c for instance a7cd4aab-65dd-44ea-9210-31ae5511a00e on hv-cinder-84614 Jul 14 11:09:42.062544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-14b8e2b0-fd01-4b33-9c9c-7bdd02e7ba14 req-77ec927a-ade4-4565-a5ff-d050cdd13208 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Jul 14 11:09:42.063113 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 501/991] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:42.620792 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:42.621433 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:42.629245 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:42.629744 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:42.630601 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:42.631093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:42.766096 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:42.774212 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-4dd4ba2a-a079-46cb-b670-cad032e01c79 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1265 microversion: 2.1 time: 0.160009 Jul 14 11:09:42.774779 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 491/992] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:42 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:43.792780 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:43.793467 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:43.800781 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:43.801233 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:43.802009 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:43.802446 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:43.940381 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:43.948258 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-3bf27ef5-82ea-44a4-b5e6-4ea3f8f63cc7 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1451 microversion: 2.1 time: 0.160217 Jul 14 11:09:43.948855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 502/993] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:43 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:43.964760 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:43.965390 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:09:43.972857 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:43.973307 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:43.974076 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:43.974510 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:44.126428 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:09:44.134128 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-78d22bad-a035-4074-9249-c7b91c3e8646 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1451 microversion: 2.1 time: 0.173247 Jul 14 11:09:44.134725 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 492/994] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:09:43 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:46.067405 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-24de8650-6864-4ff4-af00-a76ae17e8dd7 req-e2883a4c-0e05-4645-b7ed-36399b98d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cd4aab-65dd-44ea-9210-31ae5511a00e", "tag": "836d9cc5-a43b-4696-b4d2-34f25fa20d8c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:46.077154 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-24de8650-6864-4ff4-af00-a76ae17e8dd7 req-e2883a4c-0e05-4645-b7ed-36399b98d6bd service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:09:46.077704 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-24de8650-6864-4ff4-af00-a76ae17e8dd7 req-e2883a4c-0e05-4645-b7ed-36399b98d6bd service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:09:46.088859 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-24de8650-6864-4ff4-af00-a76ae17e8dd7 req-e2883a4c-0e05-4645-b7ed-36399b98d6bd service nova] Creating event network-changed:836d9cc5-a43b-4696-b4d2-34f25fa20d8c for instance a7cd4aab-65dd-44ea-9210-31ae5511a00e on hv-cinder-84614 Jul 14 11:09:46.094574 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-24de8650-6864-4ff4-af00-a76ae17e8dd7 req-e2883a4c-0e05-4645-b7ed-36399b98d6bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Jul 14 11:09:46.095137 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 503/995] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:04.028796 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:10:04.029577 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:10:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:10:09.475002 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:10:09.475996 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Thu Jul 14 11:10:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:10:13.947322 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:10:13.947817 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:10:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:10:29.616001 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:10:29.617047 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:10:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:11:14.153163 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_api:SELECT=18 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:14.154253 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG dbcounter [-] [133221] Writing DB stats nova_cell1:SELECT=42 {{(pid=133221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:14.155629 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:14.156541 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG dbcounter [-] [133220] Writing DB stats nova_cell1:SELECT=44 {{(pid=133220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:14.158945 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:14.159689 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:14.161697 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-944d277e-5abc-40f4-9c94-76ab90d976f9 req-4e49d3e7-8d85-48d6-bbb6-03830cead11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cd4aab-65dd-44ea-9210-31ae5511a00e", "tag": "836d9cc5-a43b-4696-b4d2-34f25fa20d8c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:14.168114 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:14.168648 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:14.169500 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:14.170008 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:14.170942 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-944d277e-5abc-40f4-9c94-76ab90d976f9 req-4e49d3e7-8d85-48d6-bbb6-03830cead11e service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:14.171382 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-944d277e-5abc-40f4-9c94-76ab90d976f9 req-4e49d3e7-8d85-48d6-bbb6-03830cead11e service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:14.184357 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-944d277e-5abc-40f4-9c94-76ab90d976f9 req-4e49d3e7-8d85-48d6-bbb6-03830cead11e service nova] Creating event network-changed:836d9cc5-a43b-4696-b4d2-34f25fa20d8c for instance a7cd4aab-65dd-44ea-9210-31ae5511a00e on hv-cinder-84614 Jul 14 11:11:14.189982 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-944d277e-5abc-40f4-9c94-76ab90d976f9 req-4e49d3e7-8d85-48d6-bbb6-03830cead11e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036441 Jul 14 11:11:14.191148 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 504/996] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:14.198628 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:11:14.287141 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-77bab867-498a-45e4-9f96-64febf55700b tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 204 len: 0 microversion: 2.1 time: 0.135632 Jul 14 11:11:14.290871 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 493/997] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:11:14 2022] DELETE /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:11:14.297184 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:14.298210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:14.306732 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:14.308940 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:14.309891 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:14.310433 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:14.467007 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:14.474834 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-f3545b05-464e-4ef5-8ced-3b92ce309e94 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1576 microversion: 2.1 time: 0.182110 Jul 14 11:11:14.475412 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 505/998] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:14 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:15.495595 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:15.496363 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:15.504950 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:15.505506 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:15.506461 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:15.507016 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:15.714384 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:15.724337 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-8d15fb51-df8d-4e94-b9fa-b51362ac89ac tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1576 microversion: 2.1 time: 0.234176 Jul 14 11:11:15.724901 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 494/999] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:15 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:16.310737 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-9d2e5f14-db14-449d-b57e-9f203ad588e9 req-c97d18d7-9ffe-4d96-a9bc-da69673bdf4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cd4aab-65dd-44ea-9210-31ae5511a00e", "name": "network-vif-deleted", "tag": "836d9cc5-a43b-4696-b4d2-34f25fa20d8c"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:16.321974 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-9d2e5f14-db14-449d-b57e-9f203ad588e9 req-c97d18d7-9ffe-4d96-a9bc-da69673bdf4c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:16.323068 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-9d2e5f14-db14-449d-b57e-9f203ad588e9 req-c97d18d7-9ffe-4d96-a9bc-da69673bdf4c service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:16.335866 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-9d2e5f14-db14-449d-b57e-9f203ad588e9 req-c97d18d7-9ffe-4d96-a9bc-da69673bdf4c service nova] Creating event network-vif-deleted:836d9cc5-a43b-4696-b4d2-34f25fa20d8c for instance a7cd4aab-65dd-44ea-9210-31ae5511a00e on hv-cinder-84614 Jul 14 11:11:16.342314 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-9d2e5f14-db14-449d-b57e-9f203ad588e9 req-c97d18d7-9ffe-4d96-a9bc-da69673bdf4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035433 Jul 14 11:11:16.342913 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 506/1000] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:16.749564 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:16.750215 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:16.761584 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:16.762214 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:16.763386 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:16.764093 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:16.799525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:16.800004 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:16.800447 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lazy-loading 'fault' on Instance uuid a7cd4aab-65dd-44ea-9210-31ae5511a00e {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:11:16.843001 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:16.851099 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-c9ccface-d828-451e-ba32-569c02172957 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 200 len: 1229 microversion: 2.1 time: 0.108067 Jul 14 11:11:16.851656 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 495/1001] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:16 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:17.873517 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.874686 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a7cd4aab-65dd-44ea-9210-31ae5511a00e] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:17.882793 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:17.883234 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:17.884039 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:17.884472 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:17.898230 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] HTTP exception thrown: Instance a7cd4aab-65dd-44ea-9210-31ae5511a00e could not be found. Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Request method failure captured: Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e HTTP/1.1 Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_hAW_3pAR3lrIpc0QO8hArsD6rvU3MvE29o8ifXghhvncX_cQF2nUz5YVF1EYDnRP8IV5tgrlJxPsoJU-KS4h5Ns6acxUrpIjhkZDp8BeiBmox31wZCaG5dHbgtVWlsrHi36VnA0l0NWOL9fFHpTDdajrIZiNVhdRP4XTOdllwYGKQ Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:11:17.899865 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fea9c5d098d646b89213d35f737e2308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 2e2b4b08c1b34a7f86996a806953ac1d Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance a7cd4aab-65dd-44ea-9210-31ae5511a00e could not be found. Jul 14 11:11:17.901595 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'a7cd4aab-65dd-44ea-9210-31ae5511a00e'} Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7cd4aab-65dd-44ea-9210-31ae5511a00e could not be found. Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:11:17.902544 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7cd4aab-65dd-44ea-9210-31ae5511a00e could not be found. Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7cd4aab-65dd-44ea-9210-31ae5511a00e could not be found. Jul 14 11:11:17.904213 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:17.905664 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Returning 404 to user: Instance a7cd4aab-65dd-44ea-9210-31ae5511a00e could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:11:17.905664 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-061c21e1-ee96-4f7c-ac2e-136a749a5f1e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e" status: 404 len: 111 microversion: 2.1 time: 0.034859 Jul 14 11:11:17.905664 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 507/1002] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1/servers/a7cd4aab-65dd-44ea-9210-31ae5511a00e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:11:21.018834 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:21.019361 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:21.026530 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:21.026985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:21.027813 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:21.028275 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:21.079311 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-97309557-9ca1-4281-a702-c8836e272a84 req-99a36a22-d0d3-47c3-857d-da98ac647cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ada1cc5-93f4-4d4a-b069-7b0303071070", "tag": "aadcf85d-e1cb-4737-b730-0eea8a34faa0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:21.096569 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-97309557-9ca1-4281-a702-c8836e272a84 req-99a36a22-d0d3-47c3-857d-da98ac647cde service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:21.097015 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-97309557-9ca1-4281-a702-c8836e272a84 req-99a36a22-d0d3-47c3-857d-da98ac647cde service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:21.109956 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-97309557-9ca1-4281-a702-c8836e272a84 req-99a36a22-d0d3-47c3-857d-da98ac647cde service nova] Creating event network-changed:aadcf85d-e1cb-4737-b730-0eea8a34faa0 for instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 on hv-cinder-84614 Jul 14 11:11:21.116875 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-97309557-9ca1-4281-a702-c8836e272a84 req-99a36a22-d0d3-47c3-857d-da98ac647cde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100994 Jul 14 11:11:21.117707 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 508/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:21.213074 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Going to try to terminate instance {{(pid=133221) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:11:21.300192 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-a531782e-923b-40eb-8347-b3cbad438bd2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 204 len: 0 microversion: 2.1 time: 0.286737 Jul 14 11:11:21.301318 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 496/1004] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:11:21 2022] DELETE /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:11:21.314710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:21.315526 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:21.325656 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:21.326957 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:21.327958 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:21.328609 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:21.478784 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.policy [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133220) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:21.486744 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e6fb08e4-2ebf-4ad8-a75c-559ffe1be7ae tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1576 microversion: 2.1 time: 0.178737 Jul 14 11:11:21.487313 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 509/1005] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:21 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:22.506109 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:22.506806 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:22.513588 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:22.514037 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:22.514813 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:22.515228 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:22.663585 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:22.672978 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-2c28bb9c-246c-4229-82e7-653e14ff083d tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1576 microversion: 2.1 time: 0.171185 Jul 14 11:11:22.673570 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 497/1006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:22 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:23.218439 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [req-1a5323af-d162-4c8b-9159-322de89e279f req-5a8b804d-cb00-4cbf-b62e-85815e4b8c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ada1cc5-93f4-4d4a-b069-7b0303071070", "name": "network-vif-deleted", "tag": "aadcf85d-e1cb-4737-b730-0eea8a34faa0"}]} {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:11:23.230648 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1a5323af-d162-4c8b-9159-322de89e279f req-5a8b804d-cb00-4cbf-b62e-85815e4b8c3d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:23.231262 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [req-1a5323af-d162-4c8b-9159-322de89e279f req-5a8b804d-cb00-4cbf-b62e-85815e4b8c3d service nova] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:23.246363 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.compute.server_external_events [req-1a5323af-d162-4c8b-9159-322de89e279f req-5a8b804d-cb00-4cbf-b62e-85815e4b8c3d service nova] Creating event network-vif-deleted:aadcf85d-e1cb-4737-b730-0eea8a34faa0 for instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 on hv-cinder-84614 Jul 14 11:11:23.251168 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [req-1a5323af-d162-4c8b-9159-322de89e279f req-5a8b804d-cb00-4cbf-b62e-85815e4b8c3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036614 Jul 14 11:11:23.251765 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 510/1007] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 11:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:23.694697 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:23.695233 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:23.701962 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:23.702525 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:23.703310 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:23.703734 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:23.736854 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:23.737306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:23.737753 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.objects.instance [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lazy-loading 'fault' on Instance uuid 2ada1cc5-93f4-4d4a-b069-7b0303071070 {{(pid=133221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:11:23.783408 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.policy [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e2b4b08c1b34a7f86996a806953ac1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9c5d098d646b89213d35f737e2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133221) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:11:23.792043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-25e459be-909a-48aa-8ad8-5a961239d93e tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 200 len: 1229 microversion: 2.1 time: 0.103732 Jul 14 11:11:23.792629 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 498/1008] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:23 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:24.811570 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:24.812316 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: 2ada1cc5-93f4-4d4a-b069-7b0303071070] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:24.819341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:24.820124 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:24.820900 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:24.821341 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:24.837478 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] HTTP exception thrown: Instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 could not be found. Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Request method failure captured: Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 HTTP/1.1 Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_hAW_3pAR3lrIpc0QO8hArsD6rvU3MvE29o8ifXghhvncX_cQF2nUz5YVF1EYDnRP8IV5tgrlJxPsoJU-KS4h5Ns6acxUrpIjhkZDp8BeiBmox31wZCaG5dHbgtVWlsrHi36VnA0l0NWOL9fFHpTDdajrIZiNVhdRP4XTOdllwYGKQ Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:11:24.839198 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fea9c5d098d646b89213d35f737e2308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 2e2b4b08c1b34a7f86996a806953ac1d Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 could not be found. Jul 14 11:11:24.840924 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': '2ada1cc5-93f4-4d4a-b069-7b0303071070'} Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 could not be found. Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:11:24.841975 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 could not be found. Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 could not be found. Jul 14 11:11:24.843855 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:24.845550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Returning 404 to user: Instance 2ada1cc5-93f4-4d4a-b069-7b0303071070 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:11:24.845550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-98234cf5-5957-4957-a0bb-71c70196abfc tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070" status: 404 len: 111 microversion: 2.1 time: 0.034427 Jul 14 11:11:24.845550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 511/1009] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:24 2022] GET /compute/v2.1/servers/2ada1cc5-93f4-4d4a-b069-7b0303071070 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:11:25.572348 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:25.572876 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.compute.api [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133221) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:25.579784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:25.580274 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:25.581043 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:25.581468 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG oslo_concurrency.lockutils [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:25.601784 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.wsgi [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] HTTP exception thrown: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Request method failure captured: Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: request: DELETE /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 HTTP/1.1 Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept: application/json Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Accept-Encoding: identity Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Connection: close Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Length: 0 Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Content-Type: application/json Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Host: 10.222.0.27 Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Openstack-System-Scope: None Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: User-Agent: python-urllib3/1.26.9 Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Auth-Token: gAAAAABiz_hAW_3pAR3lrIpc0QO8hArsD6rvU3MvE29o8ifXghhvncX_cQF2nUz5YVF1EYDnRP8IV5tgrlJxPsoJU-KS4h5Ns6acxUrpIjhkZDp8BeiBmox31wZCaG5dHbgtVWlsrHi36VnA0l0NWOL9fFHpTDdajrIZiNVhdRP4XTOdllwYGKQ Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Id: None Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Domain-Name: None Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Identity-Status: Confirmed Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Is-Admin-Project: True Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Id: default Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Domain-Name: Default Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Project-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Role: member,reader Jul 14 11:11:25.604306 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Roles: member,reader Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fea9c5d098d646b89213d35f737e2308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Id: default Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Domain-Name: Default Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Id: 2e2b4b08c1b34a7f86996a806953ac1d Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: X-User-Name: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: method: > Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: exception: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.606041 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: action_args: {'id': 'a9d1cdef-50ab-43b3-81eb-22803f438496'} Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:11:25.607009 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.608599 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.610136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Returning 404 to user: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. {{(pid=133221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:11:25.610136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-0b542783-9fcd-4887-8e5c-cdeb1ba88fe2 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 404 len: 111 microversion: 2.1 time: 0.037476 Jul 14 11:11:25.610136 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 499/1010] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 11:11:25 2022] DELETE /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:11:25.616741 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '>' {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:25.617420 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.compute.api [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] [instance: a9d1cdef-50ab-43b3-81eb-22803f438496] Fetching instance by UUID {{(pid=133220) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:11:25.623710 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:25.624229 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:25.624983 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:11:25.625417 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG oslo_concurrency.lockutils [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Lock "f81cba64-582e-4504-8b43-6c2a9f412413" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:11:25.639306 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.wsgi [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] HTTP exception thrown: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Request method failure captured: Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: request: GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 HTTP/1.1 Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept: application/json Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Accept-Encoding: identity Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Connection: close Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Length: 0 Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Content-Type: application/json Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Host: 10.222.0.27 Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Openstack-System-Scope: None Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: User-Agent: python-urllib3/1.26.9 Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Auth-Token: gAAAAABiz_hAW_3pAR3lrIpc0QO8hArsD6rvU3MvE29o8ifXghhvncX_cQF2nUz5YVF1EYDnRP8IV5tgrlJxPsoJU-KS4h5Ns6acxUrpIjhkZDp8BeiBmox31wZCaG5dHbgtVWlsrHi36VnA0l0NWOL9fFHpTDdajrIZiNVhdRP4XTOdllwYGKQ Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Id: None Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Domain-Name: None Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Identity-Status: Confirmed Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Is-Admin-Project: True Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Id: default Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Domain-Name: Default Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Project-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Role: member,reader Jul 14 11:11:25.640873 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Roles: member,reader Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fea9c5d098d646b89213d35f737e2308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fea9c5d098d646b89213d35f737e2308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Id: fea9c5d098d646b89213d35f737e2308 Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861657918 Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Id: default Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Domain-Name: Default Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Id: 2e2b4b08c1b34a7f86996a806953ac1d Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: X-User-Name: tempest-TestVolumeBootPattern-1861657918-project Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: method: > Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: exception: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.642550 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: action_args: {'id': 'a9d1cdef-50ab-43b3-81eb-22803f438496'} Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: {{(pid=133220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:11:25.643582 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. Jul 14 11:11:25.644960 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: ERROR nova.api.openstack.wsgi Jul 14 11:11:25.646524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: DEBUG nova.api.openstack.wsgi [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Returning 404 to user: Instance a9d1cdef-50ab-43b3-81eb-22803f438496 could not be found. {{(pid=133220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:11:25.646524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO nova.api.openstack.requestlog [None req-e417597a-996f-44c0-959b-4e32e4016cef tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496" status: 404 len: 111 microversion: 2.1 time: 0.031703 Jul 14 11:11:25.646524 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: [pid: 133220|app: 0|req: 512/1011] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 11:11:25 2022] GET /compute/v2.1/servers/a9d1cdef-50ab-43b3-81eb-22803f438496 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:11:26.962279 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: DEBUG nova.api.openstack.wsgi [None req-5106a7c2-90fd-48d8-bd96-7d2ac9a0dd44 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] Calling method '.version_select at 0x7f13d424c1f0>' {{(pid=133221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:26.986985 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO nova.api.openstack.requestlog [None req-5106a7c2-90fd-48d8-bd96-7d2ac9a0dd44 tempest-TestVolumeBootPattern-1861657918 tempest-TestVolumeBootPattern-1861657918-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-688443031" status: 202 len: 0 microversion: 2.1 time: 0.028781 Jul 14 11:11:26.987735 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: [pid: 133221|app: 0|req: 500/1012] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jul 14 11:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-688443031 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:11:48.925882 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:11:48.926579 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Thu Jul 14 11:11:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:13:29.488898 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:13:29.490191 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Thu Jul 14 11:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:13:33.957222 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:13:33.957698 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:13:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:13:49.630157 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:13:49.631285 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:13:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:15:08.936210 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:15:08.937260 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Thu Jul 14 11:15:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:16:44.042884 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:16:44.043526 dv-cinder-846146-7-iscsi devstack@n-api.service[133221]: Thu Jul 14 11:16:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:16:49.503268 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:16:49.503890 dv-cinder-846146-7-iscsi devstack@n-api.service[133220]: Thu Jul 14 11:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!